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INTRODUCTION 

Talk  Inventory  Con«tructton  Is  one  of  eight  research  areas  requested 
by  the  U.  S.  Marine  Corps  for  study  and  review  by  the  research  staff  at 
California  State  University,  Los  Angeles.  Froa  their  first  preview  and 
briefing  on  the  OMU  Task  Analysis  Program,  members  of  the  research  staff 
expressed  concern  about  the  procedures  used  to  generate  basic  data  on  what 
Marines  actually  do  In  the  performance  of  assigned  duties  or  Jobs.  Research 
staff  members  questioned  the  reliability  of  and  dependability  of  Inforsmtlon 
secured  through  administration  of  the  traditional  task  Inventories  to  Marine 
Corps  job  Incumbents. 


Studies  of  the  task  Inventory  construction  methods  used  by  the  staff  of 
the  Office  of  Manpower  Utilization  UQMC  (OMU)  suggested  that  there  might  be  a 
ntmber  of  problem  areas  In  the  existing  procedures.  Some  of  the  apparent 
problem  areas  Identified  were: 

1.  The  procedure  used  In  collection  of  Information  about  tasks  on  which 
Inventory  statements  were  based. 

2.  The  format  of  task  Inventory  booklets. 

3.  Sequencing  of  task  Inventory  statements  In  these  booklets. 

4.  Effect  of  booklet  length  on  the  reliability  and  validity  of  responses. 

5.  Effect  of  the  Identification  of  Individual  Marine  respondents  on  the 
validity  of  certain  categories  of  responses. 

6.  Reading  levels  of  Marines  as  compared  to  readability  levels  of  task 
Inventories. 
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2 

7*  Attitudes  of  Marines  towards  task  inventory  questionnaires. 

To  examine  and  evaluate  these  problem  areas,  the  research  staff  used  a 
variety  of  research  approaches,  including  a study  of  current  Marine  Corps 
Task  Analysis  procedures,  the  administration  of  reading  ability  tests  to 
samples  of  Marines,  analysis  of  readability  of  Task  Inventories,  a review 
of  the  literature  of  Task  Inventory  Construction  and  readability  measures, 
and  the  relevance  of  several  statistical  procedures. 

This  report  outlines  staff  experience  in  following  these  approaches. 
Chapter  II  defines  terms  and  states  major  hypotheses.  Chapter  III  discusses 
the  setting,  background  and  rationale  behind  these  studies.  Chapter  IV  focuses 
attention  on  the  mechanics  of  task  inventory  construction — the  steps  taken 
in  preparing  each  inventory.  Chapter  V reports  our  search  for  significant 
data  and  findings  with  respect  to  the  format  of  task  inventory  booklets,  the 
possible  influence  of  personal  identification  of  Marine  respondents,  the 
relevance  of  booklet  length,  and  the  implications  of  readability  as  a factor  in 
the  quality  of  information  provided  by  the  traditional  procedure.  Chapter  VI 
sunraarizes  findings  and  conclusions. 


TASK  INVENTORY  CONSTRUCTION  AND  TASK  ANALYSIS 


A.  AREAS  OF  RESEARCH  ASSIGNED  TO  ONR-USMC  RESEARCH  STAFF 
AT  CALIFORNIA  STATE  UNIVERSITY,  LOS  ANGELES. 

In  its  studies  of  the  Marine  Corps  Task  Analysis  Program,  the  research 
staff  at  California  State  University,  Los  Angeles  and  the  HQMC  Study  Advisory 
Coomittee  for  evaluation  of  the  Marine  Corps  Task  Analysis  Program  agreed  upon 
eight  primary  research  areas  for  study,  these  are: 


Research  Area  1* 

Task  Analysis  Observation  and  Interview  Procedures 

Research  Area  2. 

Task  Inventory  Construction 

Research  Area  3. 

Occupational  Field  Sample  Size 

Research  Area  4. 

Computer  Procedures  and  Data  Analysis 

Research  Area  5. 

OMU  Organization  and  Personnel 

Research  Area  6. 

Orientation,  Training  and  Team  Performance 

Research  Area  7. 

Peace  Time  Task  Analysis  and  Its  Relation  to  War 

Time  Conditions 


Research  Area  8. 

Worker  Characteristics. 

This  report  is  concerned  with  Research  Area  2 - Task  Inventory 
Construction.  The  results  of  studies  in  the  other  research  areas  are  reported 
in  separate  technical  reports. 

B.  TASK  INVENTORY  DEFINED. 


Task  Inventories  are  questionnaires  consisting  of  a comprehensive  set  of 
specific  statements  of  tasks  performed  by  Marines  in  a given  Occupational  Field 


(OF)  as  well  as  questions  designed  to  secure  from  each  responding  Marine  the 
following  information: 

1.  What  the  Marine  really  does. 

2.  ' Why  the  Marine  does  it. 

3.  How  the  Marine  does  it. 

4.  At  what  skill  level  (learner,  worker,  first-line  supervisor,  or 
staff  supervisor)  the  Marine  performs. 

Each  questionnaire  is  usually  divided  into  three  parts: 

Part  I is  designed  to  acquire  standard  desiographic  information  from  the 
responding  Marine  as  well  as  to  define  further  the  Marine's  Job- related 
and  military  background. 

Part  II  contains  the  list  of  task  statements. 

Part  III  contains  a series  of  Job  satisfaction  questions. 

Each  Task  Inventory  Questionnaire  applies  to  an  entire  Occupational 
Field  (OF)  and  therefore  must  cover  all  Military  Occupational  Specialties  (MOS) 
encompassed  within  that  field.  The  recommended  range  for  the  number  of 
items  or  questions  used  is  from  200  to  1,000,  with  a SMximum  of  2,000  items 
permitted  by  constraints  within  the  computer  program  used  for  processing  the 
questionnaire  responses.  The  primary  subject  matter  of  a Task  Inventory 
Questionnaire  is  the  assignment  to  an  Occupational  Field.  The  Occupational 
Field  is  divided  into  Military  Occupational  Specialties.  Each  Military 
Occupational  Specialty  is  divided  into  duties,  and  each  duty  is  composed  of 
individual  tasks.  Normally,  the  individual  task  is  the  smallest  subdivision 


identified. 


Ill 
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BACKGROUHD,  SCOPE,  AND  METHODOLOGIES  USED 

A.  BACKGROUND. 

Task  Inventory  construction  is  a major  part  of  the  Marine  Corps 
Task  Analysis  Program  (MCTAP)  which  was  Initiated  In  1969.  The  MCTAP  Is  a 
responsibility  assigned  to  the  Office  of  Manpower  Utilization,  Headquarters, 
Marine  Corps. 

Task  Inventory  construction  Is  phase  3 of  a seven  step  procedure  applied 
to  each  OF  under  study.  These  steps  are: 

1.  Study  phase. 

2.  Observation  and  Interview  phase. 

3.  Task  Inventory  construction  phase. 

4.  Inventory  administration  phase. 

5.  Processing  phase. 

6.  Analysis  phase. 

7.  Final  report  phase. 

The  task  Inventory  is  a questionnaire  covering  tasks  at  all  levels  of 
proficiency  as  well  as  questions  about  Incumbent  experience  and  training.  The 
Initial  questionnaire  Is  developed  during  the  study  phase.  This  Initial  question- 
naire Is  then  augmented  by  questions  derived  during  the  observation  and  Inter- 
view phase.  The  task  Inventory  construction  phase  Is  then  used  to  rework 
and  refine  the  questionnaire  so  that  It  will  have  maximum  effectiveness  In 
eliciting  accurate  and  useful  responses  from  the  Marine  respondents  In  the  OF. 

Questionnaire  responses  are  then  subjected  to  analysis  by  computer.  This 
analysis  reveals  variations  in  Job  duties  and  performance  that  can  lead  to 
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Improvements  in  OF  classification,  assignment,  training,  grade  and  MOS 
structure.  Job  requirements,  and  job  specifications. 

B.  SCOPE. 

The  specific  objectives  of  this  study  were  to  determine  an  optimum 
inventory  size  that  would  have  equal  or  greater  effectiveness  than  previous 
inventories,  and  to  develop  procedures  for  the  phrasing  of  task  statements 
to  avoid  ambiguities  and  be  understandable  to  as  broad  a range  of  Marines 
as  is  possible  with  such  a paper  and  pencil  instrument.  A related  objective 
was  to  develop  recommendations  for  inventory  design  and  format. 

Since  the  task  inventory  questionnaire  is  one  of  the  most  critical  tools 
of  the  task  analysis  (XA)  operation,  these  instruments  - and  the  process  by 
which  they  are  developed  - attracted  immediate  interest  and  concern  on  the 
part  of  research  staff  members.  Examination  of  these  questionnaires  raised 
such  questions  as: 

1.  Are  the  task  inventories  designed  and  adequately  tested  to  ensure 
that  they  can  and  do  provide  accurate,  dependable  data  about  what 
Marines  actually  do  in  the  performance  of  their  assignments? 

2.  Is  the  readability  level  of  the  materials  in  the  Inventories  pro- 
perly matched  to  the  reading  capabilities  of  those  who  are  expected 
to  respond  to  them? 

3.  Are  inventories  designed  and  presented  in  a form  that  will  gain 
and  hold  the  interest,  attention,  and  cooperation  of  those  who  are 
asked  to  complete  them? 

4.  Are  the  task  inventories  too  long  and  time-consuming?  What  is  an 
optimum  length? 

It  is  apparent  that  the  credibility,  dependability,  and  usefulness  of 


XA  reports  end  recotmendatlons  ere  directly  effected  by  the  quality  of 
Infomatlon  derived  from  the  adalnlstratlon  of  task  Inventory  questionnaires. 
Thus,  answers  to  the  above  questions  are  critical  to  the  significance  and 
effectiveness  of  the  entire  XA  program.  For  that  reason,  they  became  one 
of  the  eight  major  Research  Areas  In  our  study. 

C.  METHODOLOGIES  USED. 

Approaches  used  In  this  research  were  many  and  varied.  As  a preliminary 
phase  In  the  evaluative  study  of  the  XA  program  of  (MU,  our  research  staff 
members  received  a series  of  briefings  on  OMU  practices  and  experience. 

These  reviews  were  supplemented  by  direct  observation  of  the  XA  operation  In 
progress,  with  ample  opportunity  to  examine  and  discuss  the  forms.  Instruments 
and  devices  OMU  has  developed  and  used  In  various  phases  and  stages  of  the 
program.  Among  materials  examined  were  service  school  training  manuals, 
task  Inventory  booklets,  computer  programs,  and  Interim  and  final  reports 
of  completed  XA  studies. 

For  purposes  of  the  research  area  of  task  Inventory  construction,  staff 
members  observed  directly  the  first  four  phases  of  several  ongoing  XA  programs 
the  study  phase,  observation  and  Interviewing,  task  Inventory  construction, 
and  Inventory  administration.  During  these  observations,  data  were  collected, 
and  selected  portions  of  these  data  were  subsequently  subjected  to  critical 
statistical  analysis. 

Research  staff  members  made  an  exhaustive  study  of  the  literature  con- 
cerning questionnaire  construction,  format,  question  phrasing,  word-list 
utilization,  etc.  An  especially  Intensive  study  was  made  of  the  methodologies 
used  In  measuring  readability  levels  of  questionnaires.  Special  attention 
was  directed  to  practices  which  appeared  to  be  effective  when  used  In  a 
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civilian  environment  and  might  be  similarly  effective  when  applied  to 
OMU's  analysis  of  task  inventories. 


IV 


TASK  INVENTORY  CCHfSTRUCTION  - GENERAL  CONCEPTS 

A.  THE  NATURE  OF  INVENTORY  STATEMENTS. 

The  philosophy  of  the  task  analysis  process  proposes  to  Include  as 
many  tasks  as  possible  In  each  Individual  Inventory.  The  recommended  number 
of  statements  ranges  from  a minimum  of  200  to  a maximum  of  1,000,  with  an 
absolute  maximum  of  2,000,  which  Is  determined  by  the  number  of  task  statements 
that  the  computer  can  manipulate. 

To  date.  Inventory  questionnaires  have  been  constructed  In  a six-phase 
sequence,  namely,  pre-study.  Initial  task  list  development.  Initial  task  list 
review  during  observation-interview,  task  Inventory  preparation,  technical 
review  of  contents,  and  In-house  technical  review  for  format. 

Pre-study.  The  first  phase  Is  to  gather  background  data  from  several 
sources:  (1)  cognizant  agencies  at  HQMC  are  Interviewed  concerning  the 
OF  under  review;  (2)  resulting  Ideas  and  suggestions  concerning  the  OF  are 
collected  and  reviewed;  (3)  an  Interim  evaluation  Is  conducted  to  ascertain 
whether  the  study  should  proceed. 

Initial  Task  List  Development.  An  Initial  list  of  tasks  Is  developed 
using  such  sources  as  (1)  a review  of  the  literature  pertaining  to  the  OF, 

(2)  Input  from  OF  specialists,  (3)  Input  from  MOS  specialists,  and  (4)  Input 
from  other  appropriate  technical  experts. 

Initial  Task  Review  List.  Through  observation  and  Interview  of  Marine 
billet  Incumbents,  the  Initial  task  list  Is  augmented  and  tentatively  validated. 
Each  statement  is  reviewed  by  the  Incumbents  for  clarity  and  accuracy. 

Task  Inventory  Construction.  Task  analysts  and  task  inventory  construc- 
tion specialists  then  convert  the  augmented  task  list  Into  a full-scale  task 
Inventory  questionnaire. 
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Technical  Review  of  Content,  Technical  advisors  again  revlev  the 


statements  for  completeness  and  validity.  They  then  review  the  questionnaire 
to  make  sure  that  It  achieves  the  prime  objective  of  discriminating  among 
Job  types,  skill  levels,  and  other  categories  of  OF-members. 

In-House  Technical  Review.  A final  review  Is  made  by  task  analysis 
personnel  to  ensure  that  the  questionnaire  meets  all  of  the  specified  format 
criteria. 

B.  INVENTORY  DESIGN  AND  FORMAT. 

The  Inventories  presently  In  use  Include  sections  on;  (1)  background 
Information;  (2)  general  Inquiries;  (3)  duties  and  tasks,  and  (4)  Job 
satisfaction.  Sections  (1)  and  (4)  contain  questions  which  arc  similar  In 
all  studies  and  are  designed  to  obtain  specific  demographic  and  Job  satisfac- 
tion Information,  respectively. 

Background  Information.  The  section  on  background  Information  consists 
of  questions  pertaining  to:  (1)  Identification,  such  as  pay  grade,  primary 
and  other  MOS's,  and  sex;  (2)  Job  location,  such  as  type  command,  reporting 
unit  code,  and  geographic  area;  and  (3)  experience  and  other  Job  related 
Information,  such  as  time  In  current  asslgnawnt,  primary  MOS,  and  active 
service;  number  of  subordinates  supervised;  highest  educational  level  com- 
pleted; reenlistment  plans;  Job  Interest;  and  utilization  of  talents  and  training. 

General  Inquiries.  The  section  on  general  Inquiries  consists  of  questions 
to  ascertain  (1)  the  Marine's  participation  In  off-duty  college  coursework; 

(2)  his  participation  In  professional  service  schools  and  In  professional 
service  correspondence  courses;  and  (3)  various  questions  about  his  Job 


requirements 


Duties  and  Tasks.  This  section  Is  designed  to  obtain  specific  Infor* 


matlon  as  to  tine  spent  on  the  various  duties  and  tasks  Identified  during 
the  five-phase  inventory  construction  process.  Each  question  In  this  section 
pertains  to  a specific  duty  or  task  which  may  be  or  should  be  perfomed  by 
the  Marine  occupying  a given  billet. 

Unlike  the  background  and  Job  satisfaction  sections,  the  part  dealing 
with  duties  and  tasks  Is  unique  to  each  Inventory,  and  this  section  Is  pre- 
pared from  data  obtained  In  the  Study  Phase  and  the  Observation  and  Interview 
(O&I)  Phase.  It  Is  from  the  final  data  gathered  during  the  O&l  that  task 
statements  are  prepared.  Precise  methods  of  developing  task  statement  Items 
have  been  largely  determined  by  the  Individual  teams  responsible  for  each 
OF  under  study. 

The  Observation  and  Interview  phase  Is  described  In  "A  Synopsis  of  the 
U.S.  Marine  Corps  Task  Analysis  Program",  as  follows:  "After  preliminary 
Investigation  Is  conducted  In  the  Study  Phase,  analysts  then  travel  to  selected 
Marine  Corps  commands  to  observe  and  Interview  Marines  working  In  the  field 
of  study.  In  the  actual  performance  of  their  Jobs.  All  pay  grades  In  each 
billet  and  MOS  of  the  OF  are  Interviewed  so  that  the  total  spectrum  of  the 
field's  work  Is  represented.  Work  data  are  broken  down  Into  four  categories: 
Jobs,  Duties,  Tasks,  and  Elements.  For  example:  Job-Automotive  Mechanic; 
Duties  - Tune  Engine;  adjust  brakes,  repair  exhaust  s3rstems,  etc.  Tasks 
(of  tune  engine  only)  - Change  points,  change  plugs,  adjust  carburetor,  etc. 
Elements  (adjust  carburetor  only)  - Adjust  mixture,  adjust  Idle,  change  filter, 
etc."  ^ 
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"A  Synopsis  of  the  U.S.  Marine  Corps  Task  Analysis  Program",  Hdqtrs., 
USMC,  OMU  (Code  MPU) , MCB,  Quantico,  VA.,  February,  1974. 


As  a result  of  the  early  findings  in  our  research,  OMU  task  analysts 
undertook  an  experiment  to  try  to  save  time  in  the  preparation  of  Inven- 
tory statements.  This  new  approach  has  been  called  the  "Document  Research" 
method.  It  entails  the  preliminary  creation  of  a list  of  task  statements 
based  upon  a study  of  documents,  school  programs  of  Instruction,  and  other 
U.S.  Armed  Forces  task  inventories  pertinent  to  the  field  under  study. 

After  a list  of  task  statements  has  been  compiled  and  refined,  it  Is  re- 
viewed by  senior  enlisted  men  in  the  OF  under  study,  and  finally  by  task 
analysts  from  OMU  and  by  technical  advisors  from  the  OF.  Suggested  changes, 
recommendations,  additions,  or  deletions  are  evaluated , and  appropriate 
modifications  are  incorporated  Into  a preliminary  task  Inventory. 

As  a means  of  testing  this  method,  a second  task  inventory  was  con- 
structed concurrently  by  a second  TA  team  using  the  traditional  O&l  method. 
When  both  task  inventories  were  completed,  a meeting  of  the  two  TA  teams  was 
held  to  reconcile  differences  between  the  two  inventories  and  to  create  a 
single  final  form.  The  resulting  Inventory  contained  only  about  100  more 
task  statements  than  did  the  version  resulting  from  the  document  research 
method.  The  conclusion  Is  that  a more  thorough  review,  during  the  Study 
phase,  of  training  manuals  and  other  documents  describing  OF  tasks,  when 
followed  by  interviews  and  reviews  with  "experts"  of  preliminary  task 
statements,  speeds  up  the  process  of  developing  task  statements  for  inven- 
tories and  promises  to  reduce  time  and  costs  in  the  O&I  Phase* 

Job  Satisfaction/Dissatisfaction.  The  final  section  of  the  inventory 
contains  questions  designed  to  discover  the  degrees  of  respondent  satisfaction 
with  the  job,  such  as  pride  in  being  a Marine,  relationships  with  hls  boss. 

Job  utilization  of  talents,  how  he  thinks  other  people  regard  his  Job,  etc. 
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C.  SEQUENCING  THE  TASK  INVENTORY  STATEMENTS. 

Step  one  in  the  Inventory  developaent  phase  is  to  determine  what 
actual  tasks  are  to  be  Included  in  the  Inventory.  The  next  step  is  to 
arrange  the  tasks  into  some  orderly  and  rational  sequence.  In  the  past, 
the  sequencing  of  the  items  was  left  up  to  each  individual  TA  team.  Methods 
varied;  items  were  arranged  by  (1)  complete  randomisation,  (2)  organization 
by  duty  areas,  and  (3)  an  alphabetical  listing  of  tasks. 

The  randomized  arrangement  is  presumably  the  simplest  sequencing  form 
to  achieve,  since  the  statements  can  be  left  in  the  sequence  in  which  they 
were  gathered,  or  each  statement  may  be  assigned  a number  and  the  sequence 
ordered  by  use  of  a table  of  random  digits. 

A combination  of  methods  (2)  and  (3)  has  also  been  used.  In  order  to 
develop  an  inventory  that  is  easily  comprehensible  to  the  reader  and  that 
also  prevents  response  bias,  an  arrangement  of  task  items  alphabetically 
under  duty  areas  is  believed  to  be  effective  in  facilitating  accurate  responses. 
This  form  of  organization  is  used  by  the  United  States  Air  Force  in  its 
Task  Analysis  inventories.  Statements  are  assigned  to  "an  outline  of  duties 
which  are  mutually  exclusive  and  equally  general  in  coverage,  and  each  duty 
may  first  be  broken  into  a few  broad  and  mutually  exclusive  activity  state- 
ments  or  subheadings  which  completely  cover  the  duty."  This  method  is 
flexible  in  that  more  specific  items  can  be  included  if  the  duty  area  encom- 
passes more  Cask  items. 

Another  method  of  sequencing  task  items  has  been  suggested  for  experi- 
mental administration  by  our  research  staff  members  who  studied  this  question. 
This  approach  requires  definition  of  criteria  by  which  statements  will  be 

2.  Archer,  Wayne  B.  and  FruchCer,  Dorothy  A.,  THE  CONSTRUCTION,  REVIEW, 

AND  ADMINISTRATION  OF  AIR  FORCE  JOB  INVENTORIES,  Technical  Documentary 
Report  PRL-TDR- 63-21,  August,  1973. 


ordered.  The  anelyst  deteralnee  whether  the  OF  under  study  is  s hsrdwsre 


field  or  software  field  and  if  so,  whether  it  includes  highly  specialized 
duty  areas  or  aore  generalized  duty  areas. 

The  table  below  illustrates  how  the  components  determine  task  item 
arrangement: 


Hardware 

Software 

Specialized 

By  Equipment 

By  Objective 

By  Duty  Area 

By  Objective 

Generalised 

By  Equipment 

By  Duty  Area 

In  an  occupational  field  such  as  Avionics  (hardware,  specialized) 
the  resultant  structure  might  appear  as  follows: 

Black  Box  AM- -XX  (Equipment) 

Maintenance  (Objective) 

Task  1 
Task  2 
Task  N 

Repair  (Objective) 

Task  1 
Task  2 
Task  N 
etc. 

Within  each  subgroup,  task  statements  arc  randomized  to  avoid  alpha- 
betical response  bias. 

Objectives  can  be  explicit  or  implicit,  depending  upon  what  is  determined 
during  the  O&I  phase  with  respect  to  the  degree  to  which  similar  tasks  arc 
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pcrforaed  by  different  kind*  of  Incumbents  for  different  objectives. 

Operationalizing  such  a structure  requires  mich  effort  and  attention 
to  detail  on  the  part  of  task  analysts.  A complex  occupational  field  may 
include  all  four  classifications. 

Because  time  has  not  permitted  careful  testing  of  this  suggested 
arrangement,  and  in  view  of  its  requirements  of  effort  and  attention  noted 
above,  no  specific  recommendation  for  changing  sequencing  procedure  is  pro- 
posed here,  but  further  attention  is  given  to  the  problem  in  the  chapter  that 


follows 


TESTING  THE  NAJCXl  AND  MINOR  HYPOTHESES 


In  Chapter  I,  seven  problem  areas  were  described.  Hypotheses  con- 
cerning these  problem  areas  were  formulated.  Extensive  research  was  conducted 
into  the  subject  matter  of  these  hypotheses,  data  were  collected  and  analyzed, 
and  conclusions  were  drawn.  During  this  process,  other  minor  hypotheses 
were  developed,  and  questions  were  raised  which  required  answers.  This 
chapter  describes  the  research  perfonsed,  the  tests  conducted,  the  conclusions 
drawn,  and  the  recommendations  to  be  made. 

A.  THE  TWO-BOOKLET  QUESTION  AND  ANSWER  FORMAT  VS.  THE  ONE-BOOKLET  FORMAT 
AMD  OTHER  FORMAT  RELATED  CONSIDERATIONS. 

1.  The  Major  Format  Hypothesis.  The  first  principal  hypothesis  to  be 
formulated  was:  The  two-booklet  form  of  the  questionnaire,  one  booklet  for 
questions  and  one  for  answers,  tends  to  encourage  unreliable  responses  from 
the  Marines  being  interviewed. 

2.  The  Two- Booklet  Format.  As  described  in  the  preceding  chapter, 
when  the  study  commenced,  OMU  was  using  a two-booklet  format.  One  booklet 
contained  a set  of  instructions,  a section  on  background  information  about 
respondents,  a set  of  task  statements,  and  a Job  satisfaction  questionnaire. 

A second  booklet  contained  spaces  for  recording  answers.  This  second  booklet 
utilized  Farrington  3030  forms  which  are  designed  to  be  read  directly  into 

a computer  by  means  of  an  optical  scanning  device.  In  use,  the  two-booklet 
format  required  the  Marine  respondent  to  go  back  and  forth  between  the  two 
booklets  in  order  to  record  his  response  to  each  item. 
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Difficultiei  Obaerved.  Early  in  th«  research  project,  research  staff 
members  became  aware  that  the  two-booklet  format  combined  with  the  op- 
tical scanning  reading  device  created  two  major  difficulties.  First, 
since  the  optical  scanning  device  reads  marks  as  responses,  accidental, 
unintended  marks  in  the  answer  booklet  could  cause  erroneous  answers  to 
be  recorded.  In  the  process  of  moving  back  and  forth  between  the  two 
booklets  the  Marine  respondents  tended  to  make  many  misleading  marks. 

As  a result,  a considerable  amount  of  time  had  to  be  spent  by  team  mem- 
bers in  erasing  these  random  marks  in  the  booklets  in  order  to  avoid 
creating  errors  in  the  scanning  process.  This  was  a slow,  tedious,  and 
expensive  task.  Second,  both  our  staff  members  and  (MJ  were  in  agreement 
that  the  two-booklet  system  was  one  that  could  be  easily  confusing  to 
some  Marines,  frustrating  and  irritating  to  most  of  them  and  fatiguing 
to  many  of  them.  These  factors  plus  the  need  to  keep  going  back  and 
forth  between  two  booklets  could  lead  to  an  unacceptably  high  ntaaber  of 
errors  in  recording  responses  and  could  therefore  reduce  the  reliability 
of  inventory  results  below  acceptable  levels. 

Research  Performed.  Because  of  our  early  concern  about  these  potential 
difficulties  in  using  the  two-booklet  format,  research  staff  siembers  de- 
cided to  undertake  and  carefully  observe  such  an  administration  using 
the  separate  task  inventory  booklets  and  the  separate  answer  booklets. 

This  experience  reinforced  our  earlier  concerns  about  the  cumbersome 
nature  of  this  procedure.  We  informed  mU  staff  members  of  these  con- 
cerns. OMU  agreed  with  our  observations  and  immediately  proceeded  to 
search  for  alternative  methods  of  recording  responses  to  task  inventory 
items.  OMU's  willingness  to  undertake  this  investigation  was  gratefully 
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appreciated  by  the  research  staff,  and  we  wish  to  acknowledge  that  all 
subsequent  research  on  this  question  was  performed  by  OMU. 

Among  the  alternatives  proposed,  one  method  appeared  to  be  promising. 
This  Involved  the  acquisition  of  a Westlnghouse  recording  system.  In  the 
Westlnghouse  system,  the  Westlnghouse  W2300  forms  would  replace  the 
Farrington  3030  forms.  It  was  proposed  that  the  W2300  forms  be  combined 
with  the  task  Inventory  statements  In  one  booklet.  This  proposal  was 
recommended  by  the  Director,  Manpower  Plans  & Policy  Decisions,  In  his 
letter  of  13  December,  1974,  to  the  Director,  Information  Systems  Support 
and  Management  Division.  At  that  time,  we  supported  the  proposal  on  the 
basis  of  (1)  the  possible  cost  savings  that  should  result,  and  (2)  the 
Important  Improvements  In  quality  of  data  and  In  the  value,  reliability, 
and  credibility  of  the  entire  Task  Analysis  Program. 

OMU,  however,  because  the  high  capital  Investment  In  new  scanning 
equipment  required  by  the  Westlnghouse  system  was  Incompatible  with 
then  current  Marine  Corps  efforts  to  reduce  costs,  decided  to  Investigate 
other  available  methods.  To  that  end,  the  possible  adaptation  of  the 
Air  Force  Task  Inventory  answer  sheet  was  reviewed.  The  Air  Force 
offered  Its  assistance  In  "reading"  the  answer  sheets  at  Lackland  AFB 
with  its  OCR  system.  However,  factors  and  costs  suggested  that  other 
alternatives  be  reviewed  before  a final  decision  was  made. 

The  Final  Decision.  The  result  of  these  studies  was  preparation  of 
a single  task  Inventory  booklet  that  Includes  both  questions  and  task 
statements  and  responses  on  the  same  page  Immediately  following  the  Items. 
It  is  designed  for  direct  key-to-disk  transfer  of  the  responses  that  are 


pre-coded  on  each  page. 
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Conclualon*  and  Recommendations.  The  hypothcsla  thet  the  two-booklet 
format  tended  to  produce  unreliable  rcaponaes  was  supported  and  a one 
booklet  format  was  developed  and  adopted. 

Initial  task  Inventories  that  have  been  prepared  for  evaluation 
In  this  manner  have  produced  satisfying  results.  Basic  processing  costs 
appear  to  be  about  the  same  as  the  older  system,  but  considerable  staff 
time  has  been  saved  by  elimination  of  the  answer  booklets  that  required 
cleaning  up  In  preparation  for  the  former  scanning  process.  The  new 
format  appears  to  be  less  prone  to  response  errors  than  the  old  answer 
sheets,  and  the  separate  answer  booklets  used  previously.  It  also  appears 
that  chances  for  error  In  the  process  of  transferring  responses  from 
booklets  to  computer  tape  have  been  reduced. 

3.  Acknowledgement  to  WD.  Throughout  the  study  of  task  Inventory 
formats,  OMU  took  the  Initiative  In  experimenting  with  alternatives 
and  evaluating  cost-benefits,  reliability,  and  practicality  of  different 
systems.  Members  of  the  OMU  staff  not  only  deserve  recognition  for  these 
efforts,  but  they  must  also  be  given  credit  for  the  development  of  the 
new  format  and  scoring  system,  and  for  conducting  experiments  that  have 
demonstrated  the  superiority  of  the  new  method. 

As  a result,  an  Interesting  sidelight  Is  that  recommendations  have 
been  made  and  methodologies  have  been  developed  and  Implemented  prior 
to  the  completion  of  our  research  and  prior  to  the  filing  of  our  final 
report.  This  Is  In  contrast  to  the  usual  procedure  in  which  sponsors 
await  the  filing  of  a final  report  before  considering  recoseaendatlons 


or  making  changes. 


4.  Other  Format  and  Related  Hypotheaes.  During  our  research  we 


developed  two  significant  hypotheses  with  respect  to  fonnat  and  with 
respect  to  the  methodology  to  be  used  in  the  gathering  and  formulation 
of  task  inventory  statements.  These  hypotheses  were  tested,  conclusions 
were  drawn,  and  recommendations  prepared. 

a.  Task  Inventory  Statement  Sequencing  Methodology. 

Hypothesis ; The  method  of  sequencing  task  statements  in 
the  inventory  can  influence  the  validity  of  responses. 

Research  performed  by  our  staff  indicates  that  this  hypothesis 
is  true.  A number  of  sequencing  methods  was  investigated  and  a new 
method  was  developed  based  upon  a definition  of  criteria  by  which  the 
statements  will  be  ordered.  A discussion  of  this  method  is  included  in 
the  preceding  Chapter  IV,  Section  C. , Sequencing  the  Task  Inventory  Statements. 

b.  The  "Document  Research"  Method  of  Task  Inventory  Statement 

Collection. 

Hypothesis ; The  new  "Document  Research"  method  of  task 
inventory  statement  collection  is  efficient,  effective,  and 
less  costly  than  is  the  O&I  method. 

Research  performed  by  our  staff  indicates  that  this  hypothesis 
is  also  true.  The  "Document  Research"  method  is  described  in  detail  in 
Chapter  IV,  Section  B.,  Inventory  Design  and  Format.  This  is  another  example 
in  which  OMU  adopted  and  implemented  a recommendation  prior  to  the  filing 
of  the  final  report. 

B.  IDENTIFICATION  VS.  ANONYMITY  OP  RESPONDENTS. 

A second  principal  hypothesis  to  be  tested  held  that;  Identification 
of  respondents  tends  to  make  their  responses  to  the  Job  satisfaction  questionnaire 


less  reliable. 
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Part  IV  of  the  task  inventory  questionnaire  consists  of  28  questions 
(see  Table  1)  designed  to  discover  from  the  Karine  respondent  his  satisfaction/ 
dissatisfaction  with  his  Job  environment.  It  has  been  the  practice  of  the 
Marine  Corps  to  require  the  respondent  to  identify  himself  in  Part  I of  the 
questionnaire.  Since  a number  of  the  questions  in  Part  IV  express  the  respon- 
dent's attitude  towards  his  superiors  and  co-workers,  research  staff  members 
were  of  the  opinion  that  the  above  hypothesis  should  be  tested  by  comparing 
responses  to  the  job  satisfaction/dissatisfaction  questions  for  anonymous 
and  identified  subjects.  Of  the  28  questions,  numbers  I,  3,  4,  7,  11,  14, 

16,  18,  20,  23,  and  26  had  some  relationship  to  superiors  and  co-workers, 
with  questions  4,  18,  20,  and  26  involving  direct  references.  It  is  clear 
that  support  of  the  hypothesis  would  require  a significant  statistical 
difference  in  the  replies  to  questions  4,  18,  20,  and  26  by  members  of  the 
anonymous  and  identified  groups. 

In  administering  the  task  analysis  questionnaire  for  OP  46  (Photography), 
Marines  in  one  sample  were  asked  to  complete  the  identifying  information 
called  for  on  the  task  inventory  questionnaire.  Marines  in  the  other  sample 
omitted  such  data.  The  results  are  shown  in  Table  2.  Statistical  tests  of 
the  significance  of  differences  between  the  two  groups  showed  responses 
to  only  four  of  the  28  items  (items  1,  5,  24,  and  26)  to  be  significant  at 
the  .05  confidence  level.  Surprisingly,  none  of  these  four  items  is  among 
those  we  hypothesized  would  be  most  sensitive  to  bias  with  respondent  iden- 
tification. Our  conclusion  from  this  study  is  that,  in  the  Marine  Corps 
setting,  only  minimal  and  generally  non- significant  differences  result  from 
identified  respondents  to  task  inventories  as  compared  with  anonymous  respon- 


ses. The  Air  Force  came  to  this  conclusion  some  time  ago  in  its  task  analysis 


TABLE  1 


Job  Satlsfactlon/Dlssatlsfactlon  Quettlonnaire 
Source:  Part  IV,  Task  Analyals  Inventory,  OF  46  (Photography) 


1.  Being  treated  fairly. 

2.  Doing  interesting  work. 

3.  Being  respected  by  other  Marines. 

4.  Having  a supervisor  who  cares  about  your  problems. 

5.  Being  at  a duty  station  you  like. 

6.  Being  well  paid. 

7.  Feeling  that  you  arc  trusted. 

8.  Knowing  you  are  doing  an  important  job. 

9.  Being  proud  of  what  you  accomplish. 

10.  Good  living  conditions. 

11.  Getting  the  recognition  you  deserve. 

12.  Seeing  yourself  become  more  proficient. 

13.  Having  a Job  that  lets  you  lead  a satisfying  personal  life. 

14.  Good  working  conditions. 

15.  Being  respected  by  civilians. 

16.  Being  kept  informed. 

17.  Ability  to  act  on  your  own  initiative. 

18.  Having  competent  leaders. 

19.  Being  of  service  to  others. 

20.  Having  dependable  co-workers. 

21.  Opportunity  for  promotion. 

22.  Opportunity  to  do  primary  Job. 

23.  Being  with  people  you  like. 

24.  Being  we 11- trained  for  your  Job. 

25.  Opportunity  to  prove  yourself. 

26.  Seeing  the  results  of  your  work. 

27.  Your  present  Job  (overall). 

28.  The  Marine  Corps  (overall). 


Comparison  of  Anonymous  vs.  Identified  Subjects'  Responses  to  Job  Satisfaction 

Items  on  OF  46  (Photography)  Questionnaire 
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studies,  and  it  continues  to  require  identification  of  respondents  on 
task  inventories. 

C,  LONG  VS.  SHORT  TASK  INVENTORIES. 

1.  Using  the  Traditional  Full-Length  Inventory  Booklet.  The  third 
principal  hypothesis  to  be  tested  holds  that:  Lengthy  task  inventory 
questionnaires  tend  to  result  in  unwarranted  fatigue  in  the  Marine  respon- 
dent giving  rise  to  the  potential  for  unreliable  responses. 

In  its  TA  study  of  an  OF,  OMU  strives  to  include  every  essential  task 
in  its  task  inventory  for  that  field.  As  noted,  this  has  resulted  in  question- 
naires of  as  many  as  1,000  items,  requiring  as  much  as  three  to  four  hours 
for  completion  by  Marine  respondents.  A review  of  the  literature  indicates 

that  questionnaires  requiring  more  than  from  one-half  hour  to  one  hour  for 

3 

completion  result  in  less  reliable  data  than  shorter  inventories.  It  is 
contended  that  longer  questionnaires  lead  to  fatigue,  diminished  interest  in 
completing  the  task,  and  probabilities  of  reduced  reliabilities.  Reviews  of 
the  experiences  of  the  Marine  Corps  over  a period  of  some  seven  years  and 
that  of  the  Air  Force  for  some  nine  years,  at  the  time  this  report  is  writ- 
ten, suggest  that  the  variations  in  administration  of  questionnaires  and 
inventories  in  a civilian  setting  may  be  quite  different  in  effect  from  those 
of  administration  of  similar  instruments  to  military  personnel  in  a more 
disciplined  situation.  Reports  of  difficulties  arising  from  the  length 
of  inventories  in  both  military  services  have  been  extremely  rare.  Two  of 
our  studies  tend  to  support  the  feasibility  of  using  lengthy  questionnaires 
in  military  organizations. 


3.  Derman,  Diran,  French,  John  W.,  and  Harman,  Harry  H. , VERIFICATION  OF 
SELF-REPORT  TEMPERAMENT  FACTORS,  December,  1974,  Technical  Report  No.  6, 
Research  Sponsored  by  Office  of  Naval  Research. 
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a.  The  Attitude  Survey  on  Inventory  Length. 

As  a means  of  evaluating  Che  attitude  of  Marine  Respondents  to- 
ward long  cask  inventories,  our  research  staff  members  developed  and  ad- 
ministered an  attitude  survey  to  be  used  with  respondents  following  their 
completion  of  Che  long- form  inventory  booklets. 

Because  Che  attitude  survey  covers  reading  difficulty  and  other 
items  as  well  as  inventory  length,  the  general  discussion  of  the  survey  is 
included  in  the  section  on  readability  that  follows  in  this  chapter.  The 
format  used  in  the  survey  may  be  found  in  Appendix D . Of  Che  nine  questions 
used,  three  questions  relevant  to  inventory  length  were  Included: 

1.  I found  it  interesting  Co  take. 

2.  I found  it  easy  to  get  through. 

3.  The  inventory  was  too  long. 

Results  of  Che  survey  are  shown  in  Table  11,  also  in  Che  Appendix. 

A scale  of  1 to  7 ranging  from  "strongly  agree"  to  "strongly  disagree"  was 
used.  Three  OF's  were  tested:  OF02  (Intelligence  Officers),  OF  44  (Legal 
Services),  and  OF  57  (Nuclear,  Biological,  Chemical).  For  Question  1>  the 
mean  score  for  all  three  fields  was  2.4,  or  roughly  midway  between  "agree" 
and  "somewhat  agree".  For  Question  2,  Che  mean  score  was  2.1,  that  is  very 
close  to  "agree".  For  Question  3,  Che  mean  score  was  4.1,  or  close  to 
"neither  agree  nor  disagree".  The  conclusions  reached  from  the  survey  are 
that  Narine  respondents  find  the  inventory  interesting  to  take,  find  it  easy 
to  get  through,  and  are  undisturbed  by  its  length. 

b.  The  Effect  of  Inventory  Length  Upon  Task  and  Pay  Grade 

Differentiation. 

During  Che  course  of  our  research  concerning  inventory  length,  a 


fubsldiairy  hypotheali  was  formulated  and  tested:  Lengthy  Inventories 
tend  to  reflect  unreliable  responses  in  terms  of  lack  of  logical  differen- 
tiations between  Officer  and  NOO  tasks  and  among  NCO's  in  different  pay 
grades. 

Our  research  staff  members  performed  a statistical  analysis  of 
task  inventories  for  the  three  OF's  (02,  44,  and  57)  involving  comparison 
of  response  distributions,  analysis  of  variance,  and  tests  of  significance 
of  differences  between  officers  and  NOO's  and  within  the  NCO  groups.  Re- 
sults disproved  the  hypothesis.  The  analyses  reflected  logical  differences 
between  tasks  performed  by  officers  and  NOO's.  There  was  some  overlap  in 
the  higher  NCO  pay  grades,  as  would  be  expected  if  the  data  were  reliable, 
since  both  officers  and  senior  NOO's  are  supervisors  and  not  primarily  tech- 
nicians. Logical  differences  were  also  found  among  NCO's  in  different  pay 
grades.  NCO's  in  the  middle  pay  grades  were  performing  tasks  appropriate 
to  their  ranks,  and  lower  level  enlisted  grades  were  performing  more  routine 
tasks. 

2.  The  Possible  Use  of  Multiple  Mini-Length  Inventory  Booklets. 

A review  of  the  literature  caused  our  research  staff  members  to  formulate 
the  following  hypothesis:  Breaking  up  lengthy  inventories  into  short  mini- 
booklets will  improve  the  accuracy  and  validity  of  responses. 

At  the  writing  of  this  report,  the  testing  of  this  hypothesis  has  not 
been  completed;  as  a result  the  hypothesis  has  been  neither  accepted  nor 
rejected.  However,  experiments  have  been  made  in  breaking  lengthy  inventories 
into  smaller  packages,  and  it  is  recommended  that  OMU  proceed  with  the  administra- 
tion of  the  newer  mini-booklet  inventories. 

The  purpose  of  the  mini-booklet  method  is  to  reduce  the  total  number  of 


task  statements  to  which  any  one  Marine  has  to  respond.  A promising  alter- 
native to  lengthy  Inventories  ^s  found  In  an  experimental  design  developed 
In  a questionnaire  study  of  temperament  factors  made  by  Derman,  Dlran,  and 
Harman.  The  problem  addressed  In  this  study  was  how  to  obtain  full  coverage 
of  a total  of  400  Items  In  the  temperament  questionnaire  without  requiring 
all  respondents  to  answer  the  full  set  of  questions. 

In  the  temperament  questionnaire  25  factors  comprising  400  Items  plus 
a 20  Item  "desirability"  scale  were  distributed  among  30  overlapping  booklets, 
each  to  be  administered  to  a separate  sub-sample  of  the  experimental  group 
being  studied.  The  experimental  design  required  that  Items  representing  five 
of  the  25  factors  be  given  to  each  of  the  30  samples,  while  each  factor  appeared 
In  six  different  samples  so  that  comparisons  among  all  factors  could  be  made 
on  a statistically  sound  sampling  basis. 

The  basic  rationale  and  purpose  of  the  design  was  to  organize  the  task 
so  that  respondents  will  complete  an  Inventory  In  a reasonable  amount  of  time, 
one-half  hour  to  one  hour,  and  still  provide  reliable  data.  This  goal  can 
be  accomplished  In  task  analysis  by  creating  several  Inventory  booklets  for 
an  OP,  with  each  booklet  containing  various  overlapping  groups  of  tasks. 

Appendix  A gives  technical  details  of  the  experimental  design  and  the  steps 
necessary  to  develop  multiple  booklets  that  meet  the  objective  of  full  cover- 
age of  all  Items  when  all  responses  are  sunned. 

D.  READABILITY  LEVELS  OP  TASK  INVENTORIES  VS.  THE  EDUCATIONAL  LEVELS  OP 
MARINE  RESPONDENTS. 

1.  The  Hypothesis  Tested.  The  fourth  principal  hypothesis  to  be  tested 
suggests  that:  The  wording  of  the  task  Inventory  questions  frequently  does 
not  match  the  educational  level  of  the  Marine  respondent,  resulting  In  a lack 
of  comprehension  of  the  questions. 
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The  most  extensive  studies  in  this  Research  Area  involved  analyses  of 
the  readability  of  task  inventories  and  measures  of  reading  ability  levels 
of  samples  of  enlisted  Marines  at  three  West  Coast  Marine  bases.  Readability 
analyses  were  conducted  on  the  following  OF  inventories:  02  (Intelligence); 

13  (Construction,  Equipment,  and  Shore  Party);  2311  (Ammunition  Technician); 
2335  (Explosive  Ordnance  Disposal);  33  (Food  Service);  41  (Club,  Food  Service, 
Exchange,  Base  Special  Service  Officer);  43  (Public  Affiars) ; 46  (Photography); 
and  67  (Air  Control,  Anti-Air  Warfare).  Reading  ability  measures  of  samples 
of  enlisted  Marines  were  taken  at  the  Marine  Corps  Air  Station,  El  Toro,  at 
Camp  Pendleton,  and  at  the  Marine  Corps  Recruiting  Depot,  San  Diego. 

2.  Readability  Analysis  of  Task  Inventories.  As  frequently  emphasized, 
the  task  inventory  questionnaire  is  the  primary  instrument  for  data  gathering 
in  Marine  Corps  task  analysis.  It  is  compiled  after  task  analysts  have  con- 
ducted an  extensive  Investigation  into  an  OF  in  an  effort  to  identify  all  pos- 
sible tasks  a Marine  might  perform  in  his  billet.  Every  effort  is  made  to 
ensure  that  no  task  performed  in  the  OF  is  left  out  of  the  inventory.  Unfor- 
tunately, completeness  of  task  inclusion  does  not  guarantee  that  the  incumbent 
will  recognize  the  tasks  he  performs  when  he  sees  them  described  on  the  printed 
page.  It  is  considered  essential  that  all  task  statements  be  worded  to  re- 
flect the  tasks  performed  so  that  the  incumbent  can  easily  read  and  understand 
them. 

It  is  assumed  that  that  aim  is  accomplished  when  the  respondent  assigns 
"meaning  to  a printed  message  and  completes  the  act  of  communication  initiated 
by  the  writer".  ^ 

4.  Hittleman,  Daniel  R.,  Seeking  a Psvcholinguistic  Definition  of  Readability. 

THE  READING  TEACHER,  May,  1973,  pp.  783-789. 
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Readability  research  reported  in  the  literature  has  predominantly 
focused  on  the  readability  of  children's  literature.  Tbere  is  little  re- 
ported material  applicable  to  adults  and  to  instruments  such  as  Task  Analysis 

inventories.  Some  work  has  been  done  in  the  areas  of  readability  of  interest 

5 0 

inventories  and  vocational  tests.  ’ Only  one  study  was  found  Involving  an 
application  to  job  analysis.  Ash  and  Edgell  conducted  a study  to  determine 
the  readability  leveD.s  of  the  directions  and  questions  for  the  Position 

7 

Analysis  Questionnaire  (PAQ).  Many  discrepancies  were  found  between  the 
reading  levels  of  PAQ  respondents  and  readability  measures  of  PAQ  items.  As 
a means  of  preventing  frustration  in  attenpting  to  conprehend  the  test  mate- 
rial, these  authors  endeavored  to  match  the  readability  levels  of  the  tests 
to  the  reading  ability  of  their  clients.  (MJ's  task  Inventories  should  meet 
the  same  criteria.  Task  statements  and  instructions  should  be  written  at 
a readability  level  that  will  match  the  reading  ability  of  Marines  who  are 
asked  to  respond  to  them. 

One  of  the  hypotheses  in  our  research  was  that  some  Marines,  especially 
those  in  lower  technology  OF's,  could  not  read  task  inventory  questionnaires 
with  sufficient  comprehension  to  understand  them  fully.  This  hypothesis  was 
tested  in  three  steps.  Step  one  involved  measuring  the  readability  of  task 
inventories.  This  step  sought  to  determine  the  level  of  reading  ability  neces- 
sary to  understand  items  in  an  lnv«itory.  Step  two  involved  measuring  the 
reading  grade  level  of  a representative  sample  of  Marines.  This  was  done  by 


5.  Stef  fire,  Buford,  The  Reading  Difficulty  of  Interest  Inventories,  CXXUPATKXJS , 
November,  1947,  26  pp.  95-96. 

6.  Johnson,  Ralph  H.  and  Bond,  Guy  L. , Reading  Ease  of  Conmonly  Used  Tests, 
JOURNAL  OF  APPLIED  PSYCHOLOGY,  1950  , 34,  pp.  319-324. 

Ash,  Ronald  A.,  and  Edgell,  Stev«i  L. , A Note  on  the  Readability  of  the 
Position  Analysis  Questionnaire  (PAQ),  JOURNAL  OF  APPLIED  PSYCHXjOGY, 

1975,  60,  pp.  765-766. 
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adminlaterlng  the  Gates-MacGlnltlc  Reading  Test  to  a sample  of  Marines  at 
the  three  Marine  Corps  Installations  mentioned  above.  Inferences  about  the 
general  reading  level  of  Marines  were  drawn  from  these  samples.  The  third 
step  Involved  asking  Marines  who  had  completed  task  Inventories  to  express 
their  attitudes  toward  the  questionnaires. 

3.  The  Application  of  Readability  Formulas. 

a.  The  Selection  of  Formulas  to  be  Tested. 

Several  readability  formulas  were  applied  to  measure  the  difficulty 
levels  of  the  task  Inventories  listed  above.  The  use  of  more  than  one  for- 
mula was  considered  necessary  In  order  to  verify  the  results.  Originally, 
four  of  the  more  commonly  used  measures  were  selected:  the  Dale-Chall  Reada- 
bility Formula,  the  Flesch  Readability  Index,  Gunning's  FOG  Index,  and  McLaugh- 
lin's SMOG  Grading.  After  completing  the  reading  level  analysis  with  these 
four  formulas,  an  extended  search  of  the  literature  was  conducted.  We  were 
rewarded  by  the  discovery  of  a method  specifically  designed  for  use  with 
standardized  tests  that  may  have  some  sections  composed  of  word  lists  and 
other  sections  with  short  sentences  or  statements.  This  measure  Is  the 
Forbes-Cottle  Method  for  Determining  Readability  of  Standardized  Tests. 

Inasmuch  as  tasks  In  task  Inventories  are  described  by  short  sentences  or 
statements,  this  method  was  deemed  to  merit  special  attention.  We  applied 
It  to  the  nine  Inventories,  and  concluded  that  the  Forbes-Cottle  Is  probably 
the  measure  best  adapted  to  determining  readability  of  task  Inventories. 

Finally,  because  task  Inventories  tend  to  contain  many  technical  words,  the 
FORCAST  method,  which  was  developed  by  the  research  staff  at  the  Human  Resources 
Research  Organization  (HumnRRO) , specifically  to  measure  Army  technical  Job 
reading,  was  applied. 


Each  of  the  measures  was  applied  to  the  inventories  according  to  the  in- 
structions prescribed  by  their  developers.  Directions  given  in  the  task  inventory 
were  segregated  from  the  rest  of  the  inventory  so  that  each  of  these  segments 
received  individual  analysis.  The  hypothesis  for  separately  analyzing  the  in- 
structions and  task  items  is  that  the  variations  in  structure  between  the  two 
might  result  in  different  levels  of  reading  difficulty. 

The  sampling  scheme  utilized  was  to  analyze  the  instructions  in  their 
entirety,  while  a sample  of  every  third  page  of  the  task  statements  was  conducted 
independently  by  each  of  two  staff  members,  thereby  £malyzing  two- thirds  of  the 
total  task  statements.  The  only  exceptions  to  this  aaitpling  technique  occurred 
when  using  the  SMOG  index  and  the  Forbes-Cottle  formula.  The  SMOG  index  was 
applied  to  a sample  of  30  sentences  each  from  instructions  and  task  statements  in 
accordance  with  McLaughlin's  directions.  For  the  Forbes-Cottle  measure,  three 
samples  of  100  words  each  were  taken  from  both  instructions  and  task  statements. 
Appendix  B contains  expemded  san^ling  instructions  as  well  as  school  grade  level 

conversion  tables  for  the  Dale-Chall,  Flesch,  and  Forbes-Cottle  formulas. 

0 

B.  The  Dale-Chall  Readability  Formula. 

The  Dale-Chall  Readability  Formula  is  based  on  average  sentence  length  and  on 
the  percentage  of  unfamiliar  words  not  on  the  Dale-Chall  list  of  3,000  familiar  words. 
A raw  score  is  computed: 

Raw  Score  * (.0496  x average  sentence  length)  + (.1579  x % of  unfamiliar 
words)  + 3.6365. 

This  raw  score  is  then  converted  to  school  grade  level  by  referring  to  the  table 
of  scores  and  school  grades.  Table  3 shows  a comparison  of  the  school  grade  reading 
level  for  the  "instructions”  portion  of  the  task  inventory  as  measured  by 
five  of  the  six  formulas  studied.  A similar  analysis  (Table  4)  was  made 


8.  Dale,  Edgar,  and  Chall,  Jeanne  S.,  A Formula  for  Predicting  Readability, 
EDUCATIONAL  RESEARCH  BULLETIN,  January  21,  1948,  pp.  11-20,  28. 


Table  .3 


School  Grade  Level  of  Task  Inventory 
INSTRUCTIONS 

As  Measured  by  Five  Readability  Foirmulas 


Task 

Inventory 

Dale- 

Chall 

JFOG 

OF  02, 

Intelligence 

7-8 

14.46 

OF  13, 

Construction 

9-10 

11.78 

OF  2311 

Ammunition 

Technician 

7-8 

12.26 

OF  2335, 

Explosive  Ordnance 
Disposal 

7-8 

12.26 

OF  33, 

Food  Service 

11-12 

16.38 

OF  41, 

Club,  Food  Service, 
Base  Special  Service 
Officer 

9-10 

16.39 

OF  43, 

Public  Affairs 

11-12 

13.04 

OF  46, 

Photography 

9-10 

15.59 

OF  67, 

9-10 

11.71 

Air  Control, 

Anti-Air  Warfare 

Average  9-10  13.78 


Forbes- 


SMOG 

Flesch 

Cottle 

Averaqe 

10 

College 

7 

10.99 

10 

College 

8 

11.06 

9 

College 

8 

10.55 

9 

College 

8 

10.55 

11 

College 

8 

12.58 

10 

• College 

8 

11.98 

10 

College 

9 

11.91 

10 

College 

8 

11.82 

10 

College 

8 

11.04 

.9 

College 

8 

11.39 

Table  '4 


School  Grade  Level  of  Task  Inventory 
STATEMENTS 

As  Measured  by  Five  Readability  Formulas 


Task 

Inventory 

Dale- 

Chall 

FOG 

SMOG 

FLESCH 

Forbes- 

Cottle 

Averacje 

OF  02, 

Intelligence 

16 

11.26 

9 

College 

College 

12.85 

OF  13 

Construction 

16 

10.66 

8.5 

College 

College 

12.63 

OF  2311, 

Technician 

16 

11.43 

10 

College 

College 

12.49 

OF  2335, 

Explosive  Ordnance 
Disposal 

16 

13.68 

10.5 

College 

College 

13.68 

OF  33, 

Food  Service 

11-12 

11.82 

9 

College 

College 

12.16 

OF  41, 

Club,  Food  Service, 
Base  Special  Service 
Officer 

16 

17.30 

11.5 

College 

12 

14.16 

OF  43, 

Public  Affairs 

16 

14.02 

9.5 

College 

College 

13.50 

OF  46, 

Photography 

16 

10.71 

10 

College 

12 

12.54 

OF  67, 

Air  Control, 

Anti-air  warfare 

13-15 

9.92 

10 

College 

11 

li.98 

Average  15.1-15.4 

12.31 

9.8 

College 

12.89 

12.89 

35 


0 


0 


0 


0 


for  the  task  statement  section.  Table  3 reveals  that  the  Dale-Chall  measure 
suggests  somewhat  higher  scores  than  the  Forbes-Cottle  Index,  and  is  sub* 
stantially  lower  than  the  FOG,  SMOG,  and  Flesch  levels.  (Because  Flesch 
specified  "College"  as  one  level  rather  than  specific  years,  an  arbitrary  value 
of  14  was  assigned  to  the  "College"  level  in  computing  the  averages  shown  in 
Tables  3 and  4.)  Table  4,  on  the  other  hand,  shows  that  the  Dale-Chall  for- 
mula produces  the  highest  reading  grade  levels  of  the  five  formulas  when  used 
to  analyze  the  task  inventory  statements.  The  causes  of  this  variability  are 
discussed  in  Section  4 below. 

9 

c.  The  Flesch  Readability  Index. 

The  Flesch  Readability  Index  is  based  upon  average  sentence  length 
and  the  number  of  syllables  per  100  words.  A Reading  Ease  Score  is  calculated: 

Reading  Ease  Score  ■ 206.835  - (1.015  x average  sentence  length)  “(.846  x 

number  of  syllables  per  100  words) 

The  Reading  Ease  Score  is  converted  to  school  grade  level  by  means  of  a table 
of  scores  and  grade  levels.  ("College"  is  arbitrarily  scored  as  "14".) 

According  to  Tables  3 and  4,  both  for  the  task  inventory  instructions 
and  for  the  task  inventory  statements,  the  Flesch  Index  results  in  either  the 
highest  or  next  to  highest  grade  level. 

d.  Gunning's  FOG  Index. 

Gunning's  FOG  Index  is  based  upon  average  sentence  length  and  the 
percentage  of  polysyllabic  words.  The  School  Grade  Level  is  computed  by 
the  formula: 

School  Grade  Level  ^ (Average  sentence  length  + X polysyllabic 

words  X .4) 


9.  Flesch,  Rudolf  F. , THE  ART  OF  READABLE  WRITING,  New  York:  Harper  Row 
Publisher,  1949. 

10.  Gunning,  Robert,  THE  TECHNIQUE  OF  CLEAR  WRITING  (rev.  ed.),  New  York: 
McGraw-Hill  Book  Co.,  1968. 
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Table  3 (for  InstrucClont)  and  Table  4 (for  ■Catcnients)  show  chat 
the  FOG  Index  rates  instructions  at  a higher  grade  level  (an  average  grade 
level  of  13.78)  than  for  task  inventory  statements  (an  average  grade  level 
of  12.31). 

e.  McLauRhlin*s  SMOG  Grading. 

McLaughlin's  SMOG  Grading  is  based  upon  the  number  of  polysyllabic 
words  in  a 30-sentence  sample.  The  School  Grade  Level  is  computed  by  the 
formula : 

School  Grade  Level  > Square  root  of  the  number  of  polysyllabic 

words  in  a sample  (rounded  to  nearest  per- 
fect square)  + 3.0. 

Tables  3 and  4 place  the  SMOG  Grading  school  level  at  approximately 
the  tenth  grade  for  the  task  inventory  instructions  and  statements. 

f . The  Forbes-Cottle  Method  for  Determining  Readability  of 

12 

Standardized  Tests. 

The  Forbes-Cottle  Method  for  Determining  Readability  of  Standardized 

Tests  is  based  upon  the  selection  of  words  in  a sample  that  have  a weight  of 

4 or  more  in  the  THORNDIKE  JUNIOR  CENTURY  DICTIONARY.  The  formula  for 

computing  the  Index  of  Vocabulary  Difficulty  is: 

Index  of  Vocabulary  Difficulty  > sum  of  tha  weights  of  the 

difficult  words  * number  of 
words  in  the  sample  . 

The  indices  thus  computed  are  converted  into  school  grade  levels  by  means 
of  a table  of  scores. 

11.  McLaughlin,  G.  Harry,  SMOG  Grading  - A New  Readability  Formula.  JOURNAL 
OF  READING,  May,  1969,  pp.  639-645. 

12.  Forbes,  Fritz  W. , and  Cottle,  William  C. , A New  Method  For  Determininx 
Readability  of  Standardized  Tests.  THE  JOURNAL  OF  APPLIED  PSYCHOLOGY, 

Vol.  37,  no.  3,  1953,  pp.  185-190. 

13.  Thorndike,  E.  L. , THORNDIKE  CENTURY  JUNIOR  DICTIONARY  (rev.  ed.)  New  York 
Scott,  Foresman  and  Company,  1942. 
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Table  3 shows  that  for  instructions,  the  Forbes-Cottle  produces 
an  eighth  grade  readability  level  and  Table  4,  for  task  inventory  statements, 
approximately  a readability  level  of  that  of  college  freshmen. 

g.  FORCAST  Method  for  Determining  Reading  Requirements  of 

14 

Military  Occupational  Specialties. 

The  FORCAST  Method  for  Determining  Reading  Requirements  of  Military 
Occupational  Specialties  is  based  upon  a count  of  the  number  of  one-syllable 
words  in  a 150-word  passage.  The  Reading  Grade  Level  is  computed  by  the 
formula: 

RGL  ■ 20  - number  of  one- syllable  words 

10 

Table  5 shows  that  the  mean  grade  level  produced  by  FORCAST  is  quite  close 
to  the  Flesch  and  Dale-Chall  methods  with  less  variability  than  the  latter 
two. 

4.  A Comparison  of  the  Results  of  Formula  Applications. 

a.  Some  Causes  of  Variability. 

Tables  3,  4,  and  5 reveal  that  the  various  formulas  result  in  con- 
siderable variability  in  the  indicated  reading  grade  levels  required  for 
comprehension  of  the  task  inventory  questionnaires.  Research  staff  members 
expressed  concern  that  the  user  should  be  aware  of  the  reasons  for  dis- 
crepancies as  a help  in  interpreting  these  results  in  relation  to  the  true 
level  of  difficulty. 

A recurrent  warning  in  much  of  the  reported  readability  research 
is:  "For  one  thing,  word  lists  and  formulas  aren't  absolutes  --  they  don't 

l4^  Cay lor,  John  S.  and  others,  METHODOLOGIES  FOR  DETERMINING  READING  RE- 
QUIREMENTS OF  MILITARY  OCCUPATIONAL  SPECIALTIES,  Technical  Report  73-5, 
Human  Resources  Organization,  March,  1973. 


Table  5 


Cross-Validation  of  the  FORCAST  FORMULA:  Means  and  In- 
tercorrelations Among  Four  Indexes  of  Passage  Difficulty 


Index 

INTERCORRELATION 

MEAN 

SD 

1 

2 

3 

4 

1 FORCAST 

- 

.98 

.95 

.77 

9.4 

2.0 

2 Flesch 

.98 

- 

.94 

.78 

9.4 

4.2 

3 . Dale- 
Chall 

.95 

.94 

- 

.86 

9.5 

4.0 

4 Scaled 
RGL* 

.77 

.78 

.86 

10.4 

2.2 

* RGL  = Reading  Grade  Level 


SOURCE:  John  S.  Cay lor,  Thomas  D.  Sticht,  Lynn  C.  Fox,  and 

J.  Patrick  Ford,  Methodologies  for  Determining  Reading 
Requirements  of  Military  Occupational  Specialties, 

HuaRRO  - Technical  Report  73-5.  Washington,  D.C.: 

Hunan  Resources  Research  Organization,  March  1973,  17, 
Table  6. 


Hence  grade  levels  re- 
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pretend  to  be.  They  are  probability  statements'*, 
fleeted  by  readability  formulas  are  far  from  perfect  measures;  in  fact 
"it  is  generally  accepted  that  estimates  have  an  error  factor  of  approximately 

one  full  grade". 

The  tables  also  reflect  considerable  variation  among  the  results 
obtained  from  the  different  formulas.  This  finding  is  by  no  means  unique  to 
our  studies.  Reported  research  is  filled  with  similar  findings  of  varying 
results  from  the  application  of  different  sieasures  of  readability.  Few 
analyses  in  the  literature  explain  why  such  variations  occur.  Only  one  re- 
port specifically  addressed  itself  even  briefly  to  this  question.  The  author 
concluded  "that  differences  among  ratings  by  various  fonsulas  are  probably 
not  due  to  sampling  errors  or  the  ease  or  difficulty  of  the  materials  tested, 
but  are  rather  due  to  such  inaccuracies  as  are  inherent  in  the  formulas  them- 
selves". Unfortunately,  the  author  does  not  go  on  to  explain  precisely 
what  inaccuracies  may  be  causing  the  variations  nor  does  he  come  up  with  a 
hypothesis  to  account  for  the  discrepancies. 

Because  of  the  dearth  of  information  about  inconsistent  results  from 
application  of  different  measures  of  readability  we  calculated  composite 
(average)  indexes  and  reviewed  the  rationale  of  each  index  in  an  attempt  to 
develop  a more  satisfactory  hypothesis  of  our  own. 

It  appears  that  much  of  the  discrepancy  in  estimated  reading  diffi- 
cult levels  from  different  formulas  can  be  attributed  to  different  assumptions 
about  the  factors  in  readability  held  by  those  who  have  created  those  indexes. 

15.  Blair,  Allen  M. , Everything  You  Always  Wanted  to  Know  About  Readability 
But  Were  Afraid  to  Ask.  ELEMENTARY  ENGLISH,  May,  1971,  pp.  442-443. 

16.  Spache,  George  D. , GOCX)  READING  FCKl  POOR  READERS,  Champaign,  Garrard 
Publishing  Co.,  1970. 

17.  Klare,  George  R.,  Measures  of  the  Readability  of  Written  Coseminieationt 
An  Evaluation.  THE  JOURNAL  OF  EDUCATIONAL  PSYCHOLOGY,  November,  1952,  pp. 
385-399. 
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These  differences  ere  most  evident  in  the  Dele-Chell  formula,  which  is 

based  upon  average  sentence  length  and  percentage  of  unfamiliar  words  (those 

18 

not  included  on  the  DaIe>ChalI  list  of  3,000  familiar  words).  This  fonuila 

places  considerable  emphasis  on  "vocabulary  load",  which  is  defined  by  Flesch 

19 

as  "the  stock  of  words  the  reader  will  encounter  in  a piece  of  writing". 

Three  of  the  formulas  do  not  count  unfamiliar  words.  Instead  they 

use  syllable  count  combined  with  sentence  length  as  a measure  of  difficulty. 

The  Forbes-Cottle  method  assesses  word  frequency  by  use  of  the  weightings 

20 

given  in  Thorndike's  Century  Junior  Dictionary.  Flesch  contends  that 

vocabulary  load  is  an  unsatisfactory  measure  of  readability  because  "it  is 

based  on  outmoded  connectionist  theory  and  has  been  proved  unreliable  by  a 

21 

growing  body  of  research".  Flesch  prefers  to  use  syllable  count  and 
average  sentence  length  to  measure  degree  of  abstractness  and  difficulty. 

Gunning  and  McLaughlin  agree  that  syllable  count  is  an  important  factor  in 
estimating  semantic  difficulty  but  have  eliminated  the  need  to  count  every 
syllable  by  substituting  a count  of  words  with  three  or  more  syllables. 

Gunning's  FOG  index  is  based  upon  average  sentence  length  and  number  of  words 
with  three  or  more  syllables.  Words  of  three  or  more  syllables  are  considered 
to  be  polysyllabic.  McLaughlin's  SMOG  index  is  determined  by  the  number  of 
polysyllabic  words  in  a sample  of  30  sentences.  Hence  it  appears  that  the 
developers'  theories  regarding  the  factors  which  contribute  to  semantic  diffi- 
culty and  their  means  for  measuring  those  factors  may  well  be  the  most  important 

18.  Dale,  o£.  cit. 

19.  Flesch,  Rudolf  F. , A Dissenting  Opinion  On  Readability.  ELEMENTARY  ENGLISH, 
Vol.  26,  no.  6,  October,  1949,  p.  332. 

20.  See  Appendix  C for  a discussion  of  the  weighting  designation  used  by 
Thornd ike . 

21. 


Flesch,  o£.  cit. . p.  333. 


source  of  Interf omuls  variation^ 

Each  developer  tpeclflca  unique  ncthods  for  applying  his  prin- 
ciples, thus  contributing  to  further  variation  in  the  results.  For  some 
formulas,  very  precise  rules  have  been  devised  to  ensure  consistent  measure- 
ment. In  others,  many  of  the  guidelines  leave  great  leeway  for  the  user's 
discretion.  The  fomulas  also  vary  in  instructions  for  handling  certain 
terms.  For  example,  the  figure  $1,725  is  considered  a familiar  word  by  the 
Dale-Chall  method  and  therefore  does  not  Increase  estimated  difficulty.  That 
same  figure  when  evaluated  by  the  Flesch  formula,  results  in  a count  of  13 
syllables  (one  thou-sand  sev-en  hun-dred  and  twen-ty  five  dol-lars)  and  can 
substantially  increase  the  estimated  readability  level  of  a sample  of  written 
material. 

One  interesting  result  of  our  study  is  the  relationship  between  the 
SMOG  index  and  the  other  fomulas  — results  from  the  SMOG  (for  task  Inventory 
statements)  are  substantially  lower  than  from  the  other  measures.  This  re- 
lationship is  exactly  the  opposite  of  that  reported  in  most  studies.  McLaugh- 
lin himself  states  "Comparisons  show  that  SMOG  Grades  are  generally  two  grades 
higher  than  the  corrected  Dale-Chall  levels,  which  purport  to  Indicate  'the 
grade  at  which  a book  or  article  can  be  read  with  understanding'  --  a less 
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severe  criterion  than  the  one  used  here  (that  of  complete  comprehension)". 

An  attempt  to  reconcile  our  findings  with  results  reported  by  others 
suggests  that  the  sentence  fragments  which  comprise  task  statements  may  be 
a major  factor  in  the  unexpected  results.  Since  the  SMOG  calculation  is  based 
upon  a specified  number  of  sentences  rather  than  a set  sample  of  words,  the 
very  short  expressions  that  are  characteristic  of  task  statemnts  in  task 


22.  McLaughlin,  S.  Harry,  Clearing  the  SMOG.  JOURNAL  OF  READING, 
December,  1969,  pp.  210-211. 
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analysis  inventories  yield  fewer  polysyllabic  words  per  sentence  than  is 
found  in  other  types  of  writing.  This  causes  a lowered  SMOG  index.  4t 
the  same  time,  the  technical  language  results  in  many  unfamiliar  words  that 
are  not  included  on  the  Dale-Chall  List,  which  increases  the  Dale-Chall  score. 
Thus,  it  appears  that  the  unique  procedures  of  the  inventories  has  caused 
rather  distinctive  scores  for  the  Dale-Chall  and  SMOG  forsmlas  and  raises  a 
question  as  to  whether  the  Fog  and  Flesch  indices  are  likewise  affected. 

b.  Recommended  Use  of  the  Forbes-Cottle  Method. 

The  issue  of  technical  terms  inflating  estimated  reading  difficulty 
levels  of  the  task  inventories  seems  to  be  most  effectively  bypassed  by  the 
Forbes-Cottle  method.  The  developers  of  this  measure  recognize  the  limita- 
tions of  other  earlier  formulas  when  used  with  test  materials:  "The  peculiar 
swke-up  of  the  reading  matter  in  standardized  tests  required  that  only  the 
vocabulary  difficulty  factor  be  used  for  determining  their  readability.  The 

use  of  such  factors  as  sentence  length... was  not  practical  since  many  of  the 
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tests  have  sections  composed  of  word  lists". 

Difficulty  level  is  determined  in  the  Forbes-Cottle  method  by  totaling 
the  weights  of  every  third  word  that  has  a word  weight  of  4 or  more  within 
the  sample.  A more  realistic  approach  might  be  to  ignore  the  weightings  of 
common  military  and/or  Military  Occupational  Specialty  (MOS)  terms.  For 
example,  "billet"  has  a weight  of  12  assigned  to  it  by  the  Thorndike  Century 
Junior  Dictionary,  but  Marines  encounter  this  word  almost  daily  and  probably 
would  not  consider  it  at  all  difficult.  Eliminating  such  words  from  the  sample 
would  lower  estimated  difficulty  levels  and  result  in  a more  realistic  esti- 
mate of  vocabulary  difficulty. 


23.  Forbes,  op.  cit. 
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Inasnuch  ai  the  Forbes-Cottle  method  wai  designed  speclficslly  for 
use  with  questlonnsires  and  tests,  It  seems  probable  that  it  may  more  real* 
IstlcalLy  measure  the  actual  level  of  seauntlc  difficulty  of  task  Inventories 
than  do  the  other  formulas.  It  appears  to  be  the  most  appropriate  measure 
to  use  In  determining  readability  of  task  Inventories,  and  this  measure  also 
offers  the  most  practical  approach  to  gauging  the  readability  level  of  Inven- 
tories. In  applying  the  formula,  users  need  to  be  aware  that  Individual  per- 
ceptions can  Influence  which  words  are  chosen  as  being  difficult.  Professors 

Forbes  and  Cottle  discuss  the  application  of  the  method  thus:  "Each  word  that 

24 

'appeared*  difficult  to  the  grader  was  written  on  a sheet  of  paper". 

That  sentence  suggests  a high  degree  of  discretion  and  subjectivity 
In  selecting  the  difficult  words  In  each  sample.  This  kind  of  "open-ended" 
approach  presents  a distinct  disadvantage  In  the  use  of  this  method.  It 
would  be  all  too  easy  for  task  analysts  to  rationalize  that  a "difficult"  word 
was  one  whose  definition  was  unknown  to  them.  Therefore,  It  Is  an  absolute 
prerequisite  for  the  task  analysts  using  this  method  to  come  to  some  agreement 
on  a common  set  of  criteria  to  designate  what  are  "difficult"  words. 

c.  The  Potential  of  the  FCTICAST  Method. 

While  It  Is  the  belief  of  our  research  staff  members  that  the  use 
of  the  Forbes-Cottle  method  may  result  In  the  best  measure  of  school  grade 
level  reading  difficulty  of  task  Inventory  questionnaires,  we  also  believe 
that  the  FORCAST  method  may  provide  a useful  supplement.  The  FORCAST  method 
was  developed  by  the  Human  Resources  Research  Organization  specifically  to 
measure  readability  of  Army  technical  job  descriptions.  "Unlike  most  general- 
purpose  readability  formulas.  It  was  not  Intended  for  use  with  elementary 


24.  Ibid. . p.  189 
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school  msterials,  or  with  newspapers  and  magazines,  and  its  applicability  to 

25 

these  is  not  demonstrated."  Table  5 shows  the  correlations  among  this 
measure  and  the  others  that  were  discussed  in  earlier  paragraphs.  The  crea- 
tors of  FORCAST  also  recommend  its  use  over  the  others  because  of  the  simpli- 
city of  its  application. 

d.  Conclusions  Concerning  the  Variability  of  Results. 

As  hypothesized,  some  variation  exists  between  the  difficulty 
levels  of  the  task  statement  and  the  instructions.  However,  the  direction  of 
the  variation  is  not  consistent.  One  possible  explanation  (see  above) 
considers  the  factors  stressed  by  the  formula  developers.  Instructions  are 
rated  considerably  easier  than  the  task  statements  for  the  Dale-Chall  for- 
mula (9-10  grade  level  for  instructions  versus  College  graduate  level  for 
task  statements).  Since  the  instructions  do  not  contain  a large  number  of 
technical  words,  fewer  are  rated  "unfamiliar"  and  the  difficulty  level  declines. 
The  FOG  and  SMOG  measures,  however,  reflect  somewhat  greater  difficulty  levels 
for  instructions.  Evidently  the  increased  average  sentence  length  in  the 
instructions  outweighs  any  reduction  in  numbers  of  polysyllabic  words. 

With  full  recognition  that  the  inventory  structure  and  vocabulary 

tend  to  highlight  weaknesses  in  the  readability  formulas,  researchers  generally 

caution  against  relying  too  heavily  on  the  figures  obtained  from  readability 

studies.  It  is  recognized  that  "each  formula  is  really  applicable  only  to 
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the  types  of  reading  materials  on  which  it  was  based".  Since  the  fonsulas 
were  developed  on  a rather  limited  range  of  materials,  application  to  other 
forms  must  be  considered  with  some  degree  of  skepticism.  For  the  moment 


25.  Caylor,  o£.  cit. 

26.  Caylor,  L.  S.  and  others.  Measure  Readability. . .With  Saltl  EDITWIIAL 
INSTRUCTOR,  March,  1975,  p.  12. 


only  the  Forbcs-Cottlc  nethod  seems  to  offer  plausible  readability 
applications  to  testing  material. 

Perhaps  the  most  convincing  argument  against  accepting  any  single 

readability  score  as  a dependable  positive  indication  of  semantic  difficulty 

is  the  lack  of  precision  in  identifying  factors  which  influence  reading 

skills.  "Put  simply,  reading  is  complex.  There  Just  aren't  ways  to  measure 
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readability  which  fully  reflect  its  complexities  and  subtleties."  Factors 
such  as  writer  style,  reader  interest  and  motivation  greatly  influence 
readability  but  defy  easy  measurement. 

Unfortunately,  because  of  the  many  inconsistencies,  differences, 
and  built-in  limitations  of  the  various  readability  indexes,  it  is  hazardous 
to  draw  precise  conclusions  about  the  readability  of  Task  Analysis  inventories. 
Our  findings  clearly  suggest,  however,  that  their  readability  levels  stay  be 
well  above  the  reading  ability  of  the  average  Marine.  As  a result,  admini- 
stration of  such  an  inventory  may  not  provide  reliable  information.  That 
conclusion  is  supported  by  our  studies  of  reading  ability  asMng  Marines. 

5.  Measurinx  the  Readinx  Ability  of  Marines. 

a.  Use  of  the  Gates-MacGinitie  Reading  Test. 

In  the  preceding  section  the  necessary  reading  level  required  for 
an  individual  to  understand  successfully  the  task  inventory  was  discussed. 

A number  of  inventories  were  found  to  be  written  at  a level  indicating  that 
completion  of  education  through  at  least  the  tenth  grade,  and  in  some  cases 
through  the  twelfth  grade,  or  high  school,  would  be  needed  if  a Marine  were 
to  read  the  inventories  with  adequate  understanding. 

The  purpose  of  the  testing  of  reading  levels  of  enlisted  Marines 


27.  Spache,  George  D. , GOOD  READING  FOR  POOR  READERS,  Champaign,  Illinois: 
Garrard  Publishing  Company,  p.  12,  1970. 


was  to  determine  whet  proportione  of  Marinea  in  different  pay  grades  and 
different  occupational  fields  (OFs)  possess  reading  abilities  that  are 
adequate  to  comprehend  the  inventories  they  are  required  to  complete. 

Results  are  in  the  direction  that  might  be  expected.  The  majority  of  Marines 
in  the  higher  pay  grades  (E6  through  E9)  have  reading  comprehension  ability 
at  levels  Indicating  they  should  be  able  to  read  and  understand  most  task 
analysis  inventories  with  little  difficulty.  And  Marines  in  the  higher  tech- 
nology OFs,  on  the  average,  reflect  higher  levels  of  reading  ability  than 
those  who  have  an  MOS  in  one  of  the  lower  technology  OFs. 

The  Gates-MacGinitie  Reading  Tests  (Level  D)  were  administered  in 
this  study.  These  tests  provide  objective  measures  of  how  rapidly  a person 
reads,  how  accurately  he  reads  at  that  speed,  as  well  as  his  vocabulary  know- 
ledge and  reading  comprehension.  As  a single  measure,  the  Comprehension  Test 
provides  the  best  estimate  of  ability  to  read  complete  prose  passages  with 
understanding.  This  test  is  regularly  used  to  measure  the  reading  ability 
of  new  recruits  at  MCRD,  San  Diego.  It  is  also  the  only  reading  test  that 
is  administered  at  the  Recruit  Depot. 

Test  results  are  reported  in  Tables  6 through  10  in  this  report  in 
terms  of  "school  grade  scores".  The  range  of  scores  is  from  elementary  school 
grade  2.1  through  high  school  grade  11.9  on  the  Comprehension  Test  and  from 
grade  2.0  to  12.0  on  the  other  tests.  These  are  the  ranges  specified  by  the 
test  publisher  in  the  test  manual. 

Tables  6 and  7 show  the  reading  comprehension  levels  of  the  samples 
at  MCRD,  San  Diego,  and  Camp  Pendleton,  respectively.  It  is  assumed  that  at 
these  installations  there  is  a composite  of  low  and  high  technology  OFs. 

The  reading  comprehension  grade  levels  appear  to  support  this  expectation 
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Table  6 


Reading  Comprehension  of  Random  Sample  of  Permanent 
Enlisted  Staff  Personnel  Assigned  to  MCRD,  San  Diego 

Gates-MacGinitie  Reading  Test,  Level  D 
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School 


Distribution  by  Pay  Grade  and  Schcw’l  Grade  Reading  Level 


• 

Grad«  Level 

E-1 

E-2 

E-3 

E-4 

E-5 

E-6 

1:2 

E-8 

E-9 

11.9+ 

7 

14 

14 

14 

18 

20 

16 

20 

12 

11.9 

1 

4 

1 

5 

2 

6 

2 

2 

10.9 

2 

3 

1 

1 

1 

4 

1 

• 

9.9 

1 

1 

2 

1 

3 

4 

3 

3 

9.3 

3 

1 

3 

2 

1 

1 

8.7 

8,1 

3 

3 

4 

1 

7.6 

1 

1 

1 

1 

1 

7.2 

6.8 

6.5 

6.2 
6,0 

5.8 

5.6 

5.5 
5.3 
5.2 

5.0 

4.9 
4.8 

4.7 

4.6 

4.5 

3.5 

3.1 

2.2 


1 

1 

1 


1 

2 

1 


1 

1 


1 

1 


Average 


N“24 

8.7 


N-25 

10.8 


N-28 

10.1 


N-22 

10.4 


N-33 

10.5 


N*29 

11.3 


^’-32 

11.2 


N=*28 

11.3 


H“19 

11.2 


Overall  Average  School  Grade  Level  ■ 10.6 

Total  N » 240 
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Table  7 
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Reading  Con^rehension  of  Random  Sample  of  Permanent 
Enlisted  Personnel  Assigned  to  Camp  Pendleton 


GateS'MacGInItle  Reading  Test,  Level  D 


Sdiool 

Distribution  by  Pay  Grade  and  School  Grade  Reading  Level 

Grade  Level 

E-1 

• Ili 

E-3 

E-4 

E-5  E-6  E-7 

11.9+ 

11 

46 

28 

18 

13  2 1 

11.9 

1 

8 

7 

1 

10.9 

4 

7 

7 

2 

4 

9.9 

2 

5 

4 

3 

9.3 

3 

13 

5 

4 

8.7 

3 

11 

1 

8.1 

1 

10 

3 

1 

7.6 

1 

4 

2 

2 

1 

7.2 

1 

10 

2 

2 

6.8 

4 

2 

6.5 

4 

4 

1 

3 

6.2 

1 

3 

6.0 

3 

1 

1 

.5.8 

5 

1 

1 

5.6 

5 

1 

1 

5.5 

1 

1 

3 

5.3 

2 

2 

5.2 

3 

1 

5.0 

3 

1 

4.9 

2 

3 

4.8 

2 

3 

2 

4.7 

1 

1 

4.6 

2 

2 

1 

4.5 

2 

1 

1 

4.4 

5 

1 

4.2 

. 

4.1 

2 

4.0 

3 

3.9 

3.8 

2 

2 

1 

3.7 

3.5 

4 

3.4 

1 

3.3 

1 

3.2 

1 

1 

3.1 

1 

3.0 

1 

1 

2.9 

1 

1 

2.7 

1 

2.6 

1 

2.5 

1 

2.4 

1 

2.3 

2.2 

2.1 

1 

1 

N«55 

N«173 

N«75 

N«41 

N»23  N«4  N»1 

Average 

7.5 

8.5 

9.7 

9.2 

10.5  9.2  11.9+ 

E-8 


N«0 


Overall  Average  School  Grade  Level  » 8.8 


Total  N » 372 


E-9 


N«0 
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Table  8 
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I 

1 

j Reading  Comprehension  of  Random  Sample  of  Permanent 

Enlisted  Personnel  Assigned  to  MCAS,  El  Toro 

Gates-MacGinitie  Reading  Test,  Level  D 


School  Distribution  by  Pay  Grade  and  School  Grade  Reading  Level 

Grade  Level  E-1 


11.9+  9 

11.9  2 

10.9  1 

9.9  1 

• 9.3  1 

8.7  1 

8.1 

7.6  1 

7.2  1 

6.8 

• 6.5  1 

6.2 
6.0 
5.8 

5.6 
5.5 

• 5.3 
5.2 
5.0 


E-2 

E-3 

E-4 

E-5 

11 

22 

13 

21 

3 

3 

5 

4 

3 

2 

2 

2 

1 

1 

6 

2 

1 

1 

2 

1 

1 

1 


1 


E-6 

E-7 

E-8 

E-9 

23 

21 

19 

9 

4 

2 

4 

2 

1 

1 

1 

1 

1 

1 

1 


1 

1 


Average 


N=18 

10.6 


N=24 

10.8 


N=30 

11.6 


N-27 

11.2 


N-28 

11.7 


N'28 

11.9 


N»27 

11.3 


N*24 

11.9 


N*14 

11.3 


Overall  Average  School  Grade  Level  = 11.4 
Total  N = 220 
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Guam,  Japan,  American  Samoa,  Canada,  Philippines,  Okinawa 


since  there  Is  a considerable  scattering  among  the  lower  grades.  At  MCRD, 

San  Diego,  the  low  was  grade  2.2  and  at  Camp  Pendleton,  grade  2.1.  At  MCAS, 

El  Toro,  on  the  other  hand,  the  expectation  would  be  to  find  primarily  high 
technology  OFs.  Table  8 appears  to  confirm  this  expectation,  with  the  lowest 
grade>level  recorded  being  5.0.  Tables  6 through  8 also  tend  to  confirm  the 
expectation  that  Marines  In  the  higher  pay  grades  are  capable  of  higher  reading 
comprehension. 

Table  9 appears  to  Indicate  that  the  permanent  enlisted  Marines 
assigned  to  the  more  general  duties  at  Camp  Pendleton  have  a lower  average 
reading  comprehension  than  do  those  assigned  to  the  more  specialized  duties 
of  MCRD,  San  Diego,  and  MCAS,  El  Toro. 

Table  10  appears  to  Indicate  that  Marines  recruited  from  the  south 
and  assigned  to  the  less  technical  functions  of  MCRD,  San  Diego,  and  Camp 
Pendleton,  represent  a lower  average  level  of  reading  comprehension  than  those 
recruited  from  other  sections  of  the  continental  United  States.  However, 
those  presumably  In  the  higher  technology  OFs  of  MCAS,  El  Toro,  have  comparably 
high  levels  of  reading  comprehension  Irrespective  of  the  section  of  the 
U.  S.  in  which  they  received  their  schooling. 

The  data  of  Tables  6 through  10  Indicate  that,  as  was  hypothesized, 
average  levels  of  reading  ability  of  Marines  are  not  well-matched  to  the 
measured  readability  levels  of  task  Inventory  booklets.  As  a result,  data 
provided  by  respondents  may  be  questionable.  If  not  actually  erroneous. 

This  mls-match  may  generate  critical  respondent  reactions  --  Including  care- 
lessness, frustration,  and  a minimum  of  enthusiastic  cooperation  — among 
Marines  who  are  required  to  complete  these  Inventory  booklets. 
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b.  Other  Factors  in  the  Reading  Ability  of  Marines. 

In  analyzing  the  data  acquired  throu^xxit  this  research,  an 
attempt  was  made  to  pinpoint  and  determine  certain  trends  that  exist  in  the 
reading  ability  of  Marines. 

As  the  Readability  section  indicated,  the  inventories  give  evidence 
of  requiring  a relatively  high  level  of  reading  ability  for  full  comprehen- 
sion. In  subsequent  discussions  with  OMU  personnel  the  accuracy  of  this 
conclusion  was  questioned.  Their  argument  was  that  a Marine  in  his  OF  is 
highly  conversant  with  the  technical  terms  in  his  field  because  of  previous 
training  and  preparation  in  his  area  of  experience.  Nevertheless,  it  is  the 
opinion  of  the  research  staff  that  there  is  a differ^ce  between  audible 
conprehension  and  that  facet  of  comprehension  which  results  from  reading  the 

printed  page. 

In  an  effort  to  ascertain  to  some  degree  the  dimensions  of  the  prob- 
lem. a test  to  measure  the  recognition  of  technical  terms  like  organoleptic, 
sprague  unit,  viscosity,  perimeter,  etc.  was  constructed.  Unfortunately, 
development  of  the  test  was  delayed  and  we  were  not  able  to  field  test  it 
in  time  to  report  any  conclusions.  However,  it  is  recotrmended  that  CftlU  con- 
struct and  administer  such  an  instrument,  iiie  format  of  such  a "Term-recog- 
nition” instrument  is  essentially  that  of  a matching  test,  with  the  words  to 
be  identified  listed  and  numbered  alcmg  the  left-hand  side  of  the  page  and 
the  definitions  — in  ncn-corresponding  order  — spelled  out  on  the  right- 
hand  side  of  the  same  page.  Respondents  are  asked  to  match  the  terms 
with  their  correct  definitions.  Numbers  of  correct  identifications 
score  degrees  of  respondent  recognition  of  these  terms. 

On  the  basis  of  our  studies  of  the  reading  ability  of  Marines  and 
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read«bllicy  of  Inventory  instructions  and  items,  it  seems  very  clear  that 
making  task  inventories  easy  to  read  has  to  be  a matter  of  high  priority  for 

those  who  are  assigned  responsibility  for  constructing  these  smterials.  The 

effort  that  goes  into  composing  a complete  list  of  task  items  will  be  wasted 
if  the  intended  respondent  fails  to  understand  them. 

It  is  important  to  realize  that  there  is  a real  problem  of  low  read- 
ing ability  among  the  general  population  of  the  United  States.  The  trends 
prevalent  in  the  civilian  population  are  bound  to  permeate  the  rank  and  file 
of  military  organizations  at  some  juncture  in  time.  In  1966,  the  Department 
of  Defense  instituted  Project  100,000,  which  allowed  100,000  volunteers  who 
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were  not  previously  qualified  for  admission  to  the  armed  forces  to  enlist. 

With  this  reduction  in  standards,  it  appears  probable  that  an  increased  num* 
ber  of  future  recruits  will  be  deficient  in  basic  reading  skills. 

Faced  with  this  contingency,  the  Marine  Corps  has  already  taken 
steps  to  alleviate  this  deficiency.  A remedial  reading  program  has  been  es- 
tablished at  the  MCRD  in  San  Diego,  California,  for  recruits  who  score  less 
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than  a grade  level  of  4.5  on  two  alternate  reading  tests.  Thus,  4.5  is 

the  minimum  reading  level  acceptable  to  the  Marine  Corps.  The  Army  and  Navy 

require  an  ability  to  read  at  the  6th  grade  level,  while  the  Air  Force  requires 
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its  recruits  to  read  at  a level  of  the  9th  grade. 

After  our  staff  administered  reading  tests  at  three  Southern  Cali- 
fornia Marine  Corps  bases,  it  was  determined  that  the  average  reading  level 
for  the  sample  of  Marines  tested  was  approximately  a grade  level  of  10.6, 
with,  however,  a large  degree  of  variation  both  above  and  below  that  average. 


• 

28. 

Midway  Adult  School,  San  Diego,  Cal.,  PHASE  II  PILOT  RECRUIT  REMEDIAL 
READING  PROGRAM,  FINAL  REPORT  OF,  p.  1. 

29. 

Ibid.,  p.  5. 

30. 

Ibid. , p.  18. 

6.  The  Attitude  of  Marine  Respondents  to  Task  Inventory  Questionnaires 


Step  three  in  testing  the  hypothesis  that  reading  level  difficulty  of  the 
task  Inventory  questionnaires  does  not  match  the  reading  level  ability  of  the 
Marine  respondents  required  an  attitude  survey  to  determine  precisely  how 
Marine  respondents  reacted  to  the  questionnaires.  The  attitude  survey  question* 
nalre  as  developed  by  our  research  staff  members  has  been  Included  as  Appen* 
dlx  D. 

The  occupational  fields  to  which  surveys  were  administered  are: 

OF  02  (Intelligence-Officers) 

OF  44  (Legal  Services) 

OF  57  (Nuclear,  Biological,  Chemical) 

Survey  results  and  the  Ns  Involved  are  shown  In  Table  11. 

The  attitude  survey  was  constructed  by  research  staff  members  In  an  attempt 
to  obtain  first-hand  data  regarding  the  attitudes  Marines  held  after  completing 
the  task  Inventories.  It  sought  to  find  whether  the  Marines  answering  the 
Inventories  would  concur  with  our  hypothesis  that  the  Instrument  was  difficult 
to  read  and  objectionably  long.  Unfortunately,  the  samples  obtained  were  too 
small  to  justify  conclusive  findings.  Because  of  this  constraint,  recommenda- 
tions based  upon  the  results  of  the  survey  would  be  questionable.  Therefore, 
we  have  not  attempted  to  make  recommendations.  It  was  unfortunate  that  the 
scheduled  Inventory  administrations  for  low  technology  OFs  did  not  coincide 
with  the  period  In  which  the  attitude  surveys  were  conducted.  As  a result. 

It  was  not  possible  to  survey  the  reactions  of  Marines  In  lower  technology 
jobs.  This  was  particularly  unfortunate  In  view  of  the  fact  that  serious 
difficulty  In  comprehending  Inventory  Instructions  and  Items  Is  presumably 
more  common  within  this  segment  of  the  Marine  population. 


TABLE  11 
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MEAN  SCORES  ON  THE 
ATTITUDE  SURVEY 


OCCUPATIONAL  FIELDS 


SURVEY  QUESTIONS 

♦ 

02 

[ INTELLIGENCl 
OFFICERS 

X 

J 44 

Q LEGAL 

SERVICES 

X 

57 

NUCLEAR, 

BIOLOGICPJL, 

CHEMICAL 

X 

1.  I found  it  interesting  to 
take . 

..4 

2.5 

2.2 

_ . ' 

2.  I found  it  easy  to  get 
through . 

1.9 

2.0 

1 

2.3  j 

T c 

3.  It  was  easy  to  read. 

1.7 

1.8 

2.7  I 

4.  The  inventory  was  too 
long . 

4.0 

4.2 

4.1 

. 

5.  I v.'as  able  to  find  all 
the  tasks  I do. 

3.3 

3.2 

3.1 

6.  The  v;ords  used  in  the 
task  statements  were  the 
words  I use  on  the  job. 

2.8 

2.8 

3.0 

7.  The  instructions  were 
easy  to  follow. 

1.8 

1.8 

1.9 

8.  I found  many  words  I 
didn't  know. 

5.8 

5.4 

5.8 

9.  I *m  glad  I had  the  chance 
to  say  what  I do  in  my  MOS . 

2.4 

2.3 

2.0 

SCALE  DESIGNATION  | 

N=33  i N=118  i N=58 

1.  Strongly  Agree 

2.  Agree 

3 . Somewhat  Agree 

4.  Neither  Agree  no 
Disagree 


5. 

6. 
7. 


Somewhat  Disagree 
Disagree 

Strongly  Disagree 
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Nevertheless » we  believe  the  survey  to  be  a convenient  device  for 
sampling  opinions  regarding  the  inventory,  a check  which  should  be  used 
regularly  by  OMU  for  this  purpose. 

The  attitude  survey  covered  more  areas  than  reading  comprehension. 

Survey  questions  3,  6,  7,  and  8 are  directly  relevant  to  reading  ease  and 
lengths.  These  questions  had  mean  scores  of  1.7,  2.9,  1.8,  and  5.4,  respec- 
tively. Thus,  the  Marine  respondents  agreed  that  the  questionnaires  were 
easy  to  read;  "somewhat  agreed"  that  the  words  used  in  the  task  statements 
were  the  same  as  the  words  used  on  the  Job;  agreed  that  the  instructions 
were  easy  to  follow;  and  insisted  that  they  did  not  find  many  words  that 
they  did  not  know.  These  results  are  those  that  would  be  anticipated  from 
the  high  technology  areas  and  the  high  pay  grades  of  the  Marines  sampled. 

7.  Recommendations  on  Improving  Task  Inventory  Statement  Readability. 

It  is  imperative  that  the  inventory  be  as  effective  and  efficient  as  possible, 
with  most  incumbents  responding  to  it  with  a minimum  of  fatigue  and  frustra- 
tion. 

An  instrument  of  such  importance  should  be  written  as  clearly  as  possible* 

Review  of  the  literature  and  research  in  this  area  indicates  the  following 

31 

steps  as  aids  to  writing  that  minimize  reading  difficulty. 

1.  Avoid  words  that  are  unusual. 

2.  Avoid  long  words  and  "shop  talk". 

3.  Use  concrete  rather  than  abstract  words. 

4.  Avoid  technical  language. 

5.  Use  forceful  and  vivid  words. 

6.  Use  strong  nouns  and  verbs. 


31.  Pinnie,  Anthony  F. , Telling  It  Like  It  Is.  SCHOOL  AND  COMMUNITY, 
January,  1969,  p.  32. 
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7.  Avoid  figurative  language. 

8.  Use  short,  simple  sentences. 

9.  Use  short  paragraphs. 

10.  Begin  sentences  with  main  idea  in  main  clause. 

11.  Point  out  purpose  and  main  theme  early. 

12.  Use  active  rather  than  passive  voice. 

13.  Avoid  writing  slanted  toward  a particular  audience. 

14.  What  does  audience  know?  What  do  they  need  to  know? 

How  can  I best  tell  them? 

15.  When  I said  what  I had  to  say,  did  I stop? 

These  fifteen  guidelines  serve  as  an  introduction  to  the  type  of  steps 

to  take  to  produce  clearer  writing.  Another  important  suggestion  is  to  keep 

the  intended  audience  firmly  in  mind  when  preparing  the  wording  of  task  items. 

Put  another  way,  "writers  must  have  vocabularies  and  ideas  in  common  with 
32 

their  audience". 

Keeping  technical  language  to  a minimum  will  also  help  to  lower  reading 
level,  however,  some  technical  terms  may  also  be  familiar  terms  for  many  in- 
cumbents, so  it  is  best  left  to  the  discretion  of  the  task  analysts  to  deter- 
mine the  acceptability  of  technical  terms.  For  this  purpose,  it  may  be  desir- 
able to  offer  the  list  of  task  items  to  Marines  randomly  selected  from  the  OF 
under  study  to  enlist  their  opinion  as  to  whether  the  terms  are  the  actual 
words  used  for  the  task  out  in  the  field. 

The  inventory  constructor  has  a tough  job  on  his  hands.  He  has  the 
responsibility  of  seeing  to  it  that  task  items  are  accurate  and  stated  in 
familiar  terms  that  suggest  plain  talk.  An  observing  human  factors  engineer 

32.  Dale,  Edgar  and  Hager,  Hilda,  How  to  Write  to  be  Understood.  EDUCATIONAL 
RESEARCH  BULLETIN,  November,  1948,  pp.  207-216. 
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had  the  following  to  say  about  profound  and  technical  language.  "There’s 
a curious  superstition  prevalent  about  technical  writing.  Many  people 
believe  that  difficult  or  obscure  writing  is  the  mark  of  a learned  man. 

In  actual  fact  the  reverse  is  true.  Anyone  can  be  obscure  and  incoherent. 
This  takes  no  effort  whatsoever.  But,  to  write  technical  material  simply  -- 
that  takes  real  skill!" 

This  should  serve  as  warning  to  the  task  item  writer  to  scrutinize  the 
manner  in  which  tasks  are  stated.  The  more  familiar  the  writer  is  with  the 
subject,  the  more  capable  he  will  be  in  describing  the  tasks  as  simply  as 
possible. 

All  this  has  served  as  a general  introduction  to  writing  at  a lower 
reading  level,  but  the  task  inventory  constructor  has  a more  specialized 
requirement.  Murphy  discusses  what  can  be  done  to  prepare  task  statements 
with  a more  acceptable  reading  level  and  presents  a set  of  rules  that  are 


listed  below: 
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A. 


Objective  rules 

1.  Reduce  total  word  value  per  task  statement. 

2.  Reduce  average  word  value  per  task  statement. 

3.  Reduce  the  number  of  syllables  per  word. 

4.  Reduce  the  number  of  syllables  per  task  statement. 

5.  Use  double  conjunction  "and/or"  to  replace  the  conjunction 
"and"  when  a task  statement  is  composed  of  parts  which  may 
be  performed  independently. 


33 . Chapa.;is  r Alphonse  ^ Words . Words . Words  . HUMAN  FACTORS . February , 
1965.  p.  4. 

34.  Murphy,  Walter  F.,  THE  APPLICATION  OF  READABILITY  PRINCIPLES  TO  THE 
WRITING  OF  TASK  STATEMENTS;  EFFECTS  ON  READABILITY  OF  JOB  INCUMBENT 
RESPONSES,  Unpublished  Ph.D.  thesis,  Purdue  University,  1966,  pp.  58-59. 

35.  While  Murphy  recommends  the  "and/or"  form,  the  Technical  Procedures  Guide 
(op.  cit. , p«  22)  advises  against  such  use. 
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6.  Do  not  use  technical  terminology  where  the  range  of 
incumbents'  experience  may  vary  greatly. 

7.  Have  all  rewritten  statements  reviewed  by  Job  experts 
for  proper  interpretation  and  meaning. 

B.  Subjective  rules 

8.  Wording  of  a task  should  not  be  so  specific  as  to  include 
the  recipient  of  work  performed. 

9.  Task  statements  which  appear  to  be  very  general  should  be 
rewritten  in  a manner  which  confines  the  task  to  the  total 
Job  context. 

The  following  examples  illustrate  how  the  rules  are  applied. 

Rule  1.  Reduce  total  word  value  per  task  statement. 

Original.  Develop  cost  and  pricing  required  to  establish  and 
effect  procurement  support.  Total  word  value  38. 
Rewritten.  Develop  procurement  cost  and  pricing  policies. 

Total  word  value  29. 

Rule  2.  Reduce  average  word  value  per  statement. 

Original.  Supervise  the  application  of  equitable  and  uniform 
pricing  policies  among  contractors.  Average  word 
value  4.36. 

Rewritten.  Supervise  the  application  of  fair  and  equal  contract 
pricing  policies.  Average  word  value  2.6. 

Rule  3.  Reduce  the  number  of  syllables  per  word. 

Both  examples  cited  above  also  demonstrate  this  requirement 
Rule  4.  Reduce  the  number  of  syllables  per  task  statement. 

Both  examples  cited  above  also  demonstrate  this  requirement 


61 


Rule  5.  Use  double  conjunction  "*nd/or"  to  replace  "and"  when 
a task  Is  composed  of  parts  which  may  be  performed 
independently. 

Original.  Review  complaints  and  action  requests  submitted 
by  subordinate  units. 

Rewritten.  Review  complaints  and/or  requests  for  action 
from  lower  level  units. 

Rule  6.  Do  not  use  technical  terminology  where  the  range  of 
incumbents'  experience  may  vary  greatly. 

Original.  Conduct  contract  rede terminations. 

Rewritten.  Conduct  meetings  and/or  reviews  to  change  contract 
requirements. 

Rule  7.  Wording  a task  should  not  be  so  specific  as  to  include 
the  recipient  of  the  work  performed. 

Original.  Prepare  reports  on  all  litigation  involving  the 
contractor  for  the  Office  of  the  Judge  Advocate 
General. 

Rewritten.  Prepare  reports  on  legal  disputes  involving  contractors. 

Rule  8.  Task  statements  which  appear  to  be  very  general  should  be 
rewritten  in  a manner  which  confines  the  task  to  the  total 
Job. 

Original.  Conduct  surveys  of  industrial  production  methods. 

(Mote:  It  would  be  a rare  individual  who  could  do 
this  without  assistance.  It  is  more  probable  that 
one  may  preside  as  chairman  or  assist  as  a member  of 
a group  in  doing  this.) 
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Rewritten,  Conduct  or  assist  In  reviews  of  production 
methods  used  In  Industry. 

At  best,  the  rewording  of  noun  phrases  Is  a difficult  task.  For- 
tunately, the  verb  portion  of  the  task  Item  Is  more  amenable  to  substi- 
tution. Sources  of  substitutes  for  verbs  may  be  found  In  an  established 
thesaurus  like  Roget's  or  In  an  Activity  Verb  List,  as  well  as  the  Glossary 
of  Action  Verbs  Used  In  Naval  Occupational  Analysis. 

There  Is  significant  value  In  using  an  Activity  Verb  List.  It  defines 
verbs  so  that  they  delineate  significant  distinctions  among  actions  or  acti- 
vities. "With  the  activity  verb  list  at  hand,  the  analyst  has  before  him 

36 

a standardized,  classified,  and  Indexed  vocabulary."  (See  APPENDIX  F,) 

In  writing  task  items  the  constructor  should  be  careful  to  choose  verbs 

that  convey  the  precise  action  he  intends  to  describe.  The  word  "assist" 

may  be  used  as  an  example.  In  the  American  Heritage  Dictionary  it  is  defined 
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as  "an  act  of  giving  aid".  The  fuller  definition  in  the  Activity  Verb 
List  is  "to  give  support  or  aid  especially  in  some  undertaking  or  effort: 
aid".  The  fuller  definition  provided  in  the  List  will  help  the  constructor 
to  give  a precise  description  of  the  task.  The  arrangement  of  the  List  is 
also  valuable  in  that  there  are  sub*groups  of  words  simlllar  to  the  main 
heading.  "Assist"  would  be  found  under  the  main  heading  of  Serving,  with 
subdivisions  of  assist,  attend,  and  supply.  Such  distinct  demarcation  of 
duties  performed  could  aid  the  respondent  to  recognize  his  tasks  clearly. 


36.  Stone,  C.  Harold,  and  Yoder,  Dale,  JOB  ANALYSIS , 1970, (Ibid. ) . 

37.  Davies,  Peter,  ed.,  AMERICAN  HERITAGE  DICTIONARY,  New  York:  Dell  Pub- 
lishing Company,  Inc.,  1973. 
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CONCLUSIONS  AND  R£C(»MENDATIONS 


This  report  describes  research  designed  to  evaluate  task  analysis 
Inventories  as  OMU's  principal  source  of  basic  data  In  the  OMU  Task  Analysis 
program.  The  major  questions  raised  by  the  research  staff  were: 

(1)  What  are  the  major  strengths  and  limitations  of  these  Inventories 
as  they  have  been  developed  and  used  to  play  a key  role  In  the  Task  Analysis 
procedure? 

(2)  How  can  their  effectiveness  and  contribution  --  and  the  quality 
of  the  data  they  provide  --  be  Improved? 

For  answers  to  these  questions,  research  staff  members  directed  their 
attention  to  the  characteristics  of  the  questionnaires  or  booklets  with  which 
OMU  solicits  and  collects  responses  that  Identify  In  detail  what  Marines  In 
the  OFs  under  study  actually  do  In  performing  their  day-by-day  assignments. 

A careful  review  of  current  practices  and  of  the  literature  published 
the  Marine  Corps  and  other  defense  agencies  revealed  the  existence  of  a 
number  of  problem  areas.  Intensive  search  for  possible  solutions  and  Improve- 
ments In  existing  practice  has  appeared  to  justify  a number  of  conclusions. 

The  resulting  recommendations  for  Improvement  which  are  presented  In  this 
report  should,  If  adopted,  markedly  Increase  the  effectiveness  and  contri- 
bution of  the  task  Inventory  questionnaire  In  OMU's  Task  Analysis  program. 

Research  staff  members  used  a wide  variety  of  research  techniques  to 
explore  problem  areas  and  to  discover  and  formulate  potentially  promising 
changes.  In  addition  to  the  critical  review  of  existing  practices  and  the 
study  of  current  relevant  literature,  techniques  Include  the  administration 
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of  both  standardized  and  specially  developed  tests  in  the  field,  and 
statistical  analysis  of  significant  variables. 

The  following  is  a concise  sunnary  of  the  major  problem  areas, 
research  findings  and  results,  and  recommendations  for  future  practice. 

Task  Statement  Collection.  A first  step  in  the  construction  of  the  task 
inventory  questionnaire  is  collection  of  task  statements.  The  objective  is 
to  develop  a bank  of  statements  so  broad  and  Inclusive  that  it  covers  all 
tasks  performed  in  the  OF  under  study.  The  nximber  of  statements  in  each 
questionnaire  has  ranged  from  a minimum  of  200  to  a maximum  of  1,000,  with 
an  absolute  limit  of  2,000  based  upon  the  capacity  of  the  computer  program 
(CODAP)  used  for  analysis  of  inventory  responses. 

The  basic  method  of  discovering  tasks  to  be  included  in  a task  inventory 
is  the  observation  and  interview  method.  This  method  is  effective  but  it 
is  also  time-consuming  and  costly.  It  requires  a task  analysis  team  to  visit 
areas  wherever  the  work  is  performed,  to  observe  the  performance  of  Marines 
in  their  assigned  duties,  and  to  interview  OF  members  concerning  their 
activities.  This  process  typically  results  in  a long  and  inclusive  list 
of  task  statements. 

Research  staff  members  suspected  that  task  statements  could  be  collected 
without  expending  the  large  amount  of  time  and  money  involved  in  transporting 
task  analysis  teams  to  all  of  the  work  areas  under  study.  As  a result  of  our 
research,  (MJ  developed  a procedure  which  is  called  "Document  Research"  method. 
Task  statements  are  derived  by  studying  existing  publications  and  other  docu- 
ments, such  as  training  manuals,  service  school  textbooks,  manufacturers' 
instruction  sheets,  etc.  These  are  reviewed  with  "experts"  in  the  OF  and  are 
then  validated  and  supplemented  by  the  06el  method.  This  preliminary  prepa- 
ration of  statements  greatly  speeded  up  the  06el  process  and  saved  time  and  costs. 


We  have  concluded  that  the  best  method  for  obtaining  accurate  and  complete 
data  for  building  a task  inventory  appears  to  be:  (1)  thorough  review  of  all 
available  background  data  in  written  materials  describing  duties  in  an  OF, 
supplemented  by  interviews  with  ’’experts**,  (2)  preparing  preliminary  task 
statements  based  upon  this  information,  and  (3)  conducting  observation  and 
interview  visits  to  field  installations  to  validate  or  correct  these  items 
and  to  search  out  tasks  not  revealed  in  preliminary  reviews. 

Question  and  Answer  Booklets,  After  a task  inventory  questionnaire  is 
constructed,  it  must  be  administered  to  Marine  respondents  who  provide  the 
required  answers.  The  physical  means  used  to  record  the  answers  has  an 
influence  on  the  accuracy  and  dependability  of  these  responses. 

At  the  time  the  study  began,  a two-booklet  format  was  in  use.  One 
booklet  contained  the  task  statements,  and  the  second  booklet  provided  spaces 
for  the  answers,  which  consisted  of  marks  to  be  read  by  an  optical  scanner 
as  input  to  the  computer.  Two  problems  resulted  from  this  format.  First, 
the  transfer  of  the  Marine’s  attention  from  the  statement  booklet  to  the 
answer  booklet  introduced  inaccuracies  in  the  responses.  Second,  the 
respondent  tended  to  make  irrelevant  marks  in  the  answer  booklets,  marks 
which  could  be  read  as  responses  by  the  optical  scanner.  As  long  as  the  two- 
booklet  format  was  used,  little  could  be  done  about  the  first  problem.  To 
resolve  the  second  problem,  the  task  analysis  team  had  to  erase  all  irrele- 
vant marks  --a  time-consuming,  costly  process. 

The  01‘R^  staff  investigated  a variety  of  possible  booklet  formats,  and 
recommended  t.ie  adoption  (a  recommentation  with  which  we  concurred)  of  the 
Westinghouse  W2300  optical  scanning  system.  This  reconmenda tion  was  not 
implemented  because  of  the  high  capital  cost  of  the  necessary  new  equipment. 

OMU  then  developed  a single-booklet  format  wherein  the  response  space  is 
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located  alongside  the  task  statement.  Responses  are  then  transferred  to 
computer  storage  by  the  key-to-disk  method.  This  revision  has  been  used 
and  has  proved  to  not  only  be  highly  satisfactory,  but  it  has  saved  time 
and  money  and  has  improved  accuracy  in  both  the  marking  by  respondents 
and  in  processing  the  data. 

Task  Statement  Sequencing.  Analysis  has  indicated  that  the  sequencing 
of  the  task  statements  in  the  task  inventory  questionnaire  can  influence 
the  val'dity  of  responses  --  that  is,  the  answer  to  one  statement  may  influ- 
ence the  answer  to  another  statement  if  the  two  statements  are  presented 
near  each  other. 

A variety  of  sequencing  arrangements  has  been  used,  including  complete 
randomization,  organization  by  duty  areas,  and  alphabetical  listing  of  tasks. 

As  a desirable  substitute,  we  developed  and  recommend  a sequencing 
procedure  in  which  the  OFs  under  study  are  categorized  as  to  being  hardware 
or  software  and  specialized  or  generalized.  Complex  OFs  may  require  Items 
in  all  four  categories.  Within  each  category,  task  statements  are  arranged 
in  a randomized  order.  At  the  time  of  this  report,  the  method  has  not  been 
field  tes*:cd,  but  further  experimentation  is  recommended. 

Task  Inventory  Length.  In  order  to  cover  each  entire  OF,  from  200  to 
1,000  cask  statements  have  been  prepared.  Such  a lengthy  questionnaire  may 
require  from  three  to  four  hours  response  time.  Authorities  on  the  subject 
have  found  that  response  time  on  comparable  questionnaires  should  usually  be 
limited  to  from  one-half  hour  to  one  hour.  Longer  response  times,  they  have 
found,  result  in  inaccuracies  traceable  to  fatigue  and  boredom. 

The  research  staff  has  investigated  and  recommended  a technique  whereby 
such  a long  inventory  can  be  broken  up  into  a number  of  mini-booklets.  Each 
t ini-booklet:  contains  an  equal  portion  of  the  total  questionnaire  and  all 
sections  include  overlapping  task  statements.  The  effect  of  the  overlap  Is 


to  permit  all  responses  to  be  summed  and  then  subjected  to  standard  sta* 
tistical  analyses.  Thus  each  Marine  respondent  answers  one  mini-booklet, 
while  the  entire  set  of  booklets  is  administered  to  the  total  group  of 
Marines . 

Identification  of  Respondents,  Part  IV  of  the  task  inventory  question- 
naire deals  with  job  satisfaction/dissatisfaction.  Because  many  of  the 
questions  pertain  to  relations  with  supervisors  and  co-workers,  it  was 
hypothesized  that  the  Marine's  knowledge  that  he  could  be  personally  iden- 
tified with  his  responses  could  result  in  guarded,  invalid  responses. 

At  our  request,  a questionnaire  was  administered  to  two  groups  of 
Marines  completing  inventories,  one  group  being  required  to  fill-in  identi- 
fying information,  and  the  other  group  remaining  anonymous.  Analysis  dis- 
closed no  significant  difference  between  the  two  sets  of  responses  for  any 
of  the  questions  that  research  staff  members  considered  to  be  most  likely  to 
be  subject  to  bias.  We  therefore  recommend  that  Marine  respondents  continue 
to  fill-in  the  identifying  information. 

Reading  Ability  vs.  Readability.  No  matter  how  complete  a task  inven- 
tory questionnaire  is,  responses  will  be  of  dubious  dependability  if  Marine 
respondents  cannot  read  and  understand  the  task  statements  with  full  compre- 
hension. It  was  decided,  therefore,  to  measure  both  the  reading  ability  of 
Marine  respondents  and  the  reading- level  required  by  task  statements  and 
instructions.  If  the  reading-level  required  by  the  questionnaire  is  above 
the  reading  ability  of  the  respondents,  responses  are  of  doubtful  value. 

We  administered  the  Ga tes-MacGinitie  Reading  Test  to  three  samples  of 
Marines.  Individual  reading  abilities  ranged  from  school  grade  2.1  through 
12.  These  samples  Indicated  that  in  the  higher  technology  OFs  and  in  the 


higher  pay  grades » reading  levels  tended  to  be  at  the  upper  end  of  the  school 
grade  scale. 

Measurement  of  the  readability  of  questionnaires  turned  out  to  be  more 
complex.  Unfortunately 9 results  from  the  application  of  several  scales 
proved  to  be  inconsistent  both  as  among  the  various  tests  and  within  a single 
test  when  applied  separately  to  questionnaire  instructions  and  task  state* 
ments.  Research  staff  members  selected  the  Forbes*Cottle  Method  for  Deter* 
mining  Readability  of  Standardized  Tests  as  being  the  most  appropriate  for 
testing  task  inventory  questionnaires.  Application  of  the  Forbes*Cottle 
method  revealed  that  the  reading  level  required  for  these  questionnaires 
ranged  from  the  10th  to  12th  grades. 

If  these  measures  are  accepted,  then  clearly  Marine  respondents  whose 
reading  levels  are  below  grade  10  would  have  difficulty  in  understanding  the 
questionnaires. 

As  a means  of  inproving  the  readability  of  questionnaires,  two  recomrocn* 
dations  are  included  in  this  report.  First,  a set  of  rules  for  the  improved 
wording  of  task  statements  is  included  in  the  body  of  the  report.  Second, 
an  activity  verb  list  for  use  in  preparing  items  is  included  in  Appendix  F. 

Attitudes  of  Marine  Respondents.  Concern  was  expressed  that  Marine 
respondents  may  develop  a negative  attitude  toward  answering  the  task  inven* 
tory  questionnaires  because  of  their  length  or  difficulty.  To  ascertain  the 
attitudes  of  respondents,  research  staff  members  devised  and  administered  an 
attitude  survey  to  several  groups  of  respondents.  There  was  little  evidence 
from  that  survey  that  supports  the  hypothesis  that  respondents  actually  de* 
velop  negative  attitudes.  Research  staff  members  conclude  that  adoption  of 
the  recormienda tions  outlined  in  this  report  will  further  improve  the  attitudes 


of  respondents.  Nevertheless,  hazards  are  so  significant  that  we  recommend 
that  OMU  use  such  an  attitude  survey  regularly  to  detect  the  emergence  of 
negative  or  unfavorable  reactions  among  respondents. 

Supplementary  Aids  Included.  The  text  of  this  report  is  supplemented 
by  an  annotated  bibliography  on  the  measurement  of  readability  as  well  as 
by  a more  extensive  general  bibliography  relevant  to  the  broader  range  of 
questions  raised  throughout  the  entire  research  area  covered  by  this  report. 

As  another  potentially  helpful  addition  to  the  test,  a series  of  six 
appendices  details  instructions  for  preparing  mini-booklets,  specifies  the 
basic  formulas  underlying  each  of  the  six  readability  indexes  discussed  in 
the  text,  explains  the  Thorndike  system  of  establishing  word -frequency  weights, 
tabulates  the  attitudes  expressed  by  Marine  respondents  after  their  comple- 
tion of  traditional  task  inventory  booklets,  and  provides  two  word  lists, 

(1)  the  Dale  list  of  familiar  words,  and  (2)  an  activity  verb  list. 


ANNOTATED  BIBLIOGRAPHY 


Archer,  Wayne  B.  and  Fruchter,  Dorothy  A.,  THE  CONSTRUCTION, 
REVIEW,  AND  ADMINISTRATION  OF  AIR  FORCE  JOB  INVENTORIES, 
Technical  Documentary  Report  PRL-TDR-63-21,  Lackland  Air 
Force  Base,  Texas:  Personnel  Research  Laboratory,  Aerospace 
Medical  Division,  Air  Force  Systems  Command,  August  1973. 

This  report  describes  the  measures  taken  to  improve 
procedures  for  constructing  and  administering  Air  Force 
inventories.  Source  materials  for  duty  and  task  statements 
were  evaluated. 

Cay lor,  John  S.  and  others,  METHODOLOGIES  FOR  DETERMINING 
READING  REQUIREMENTS  OF  MILITARY  OCCUPATIONAL  SPECIALTIES, 
Technical  Report  73-5,  Carmel,  Calif.:  Human  Resources 
Research  Organization,  March  1973. 

This  book  describes  the  special  reading  needs  and  limi- 
tations of  enlistees  and  what  steps  must  be  taken  to 
ensure  that  they  do  not  encounter  reading  demands  beyond 
their  abilities  in  their  MOS . A discussion  of  the 
FORCAST  readability  measure  and  other  readability  formulas 
is  included. 

Chall,  Jeanne  S.,  READABILITY:  AN  APPRAISAL  OF  RESEARCH  AND 
APPLICATION,  Columbus,  Ohio:  The  Ohio  State  University, 

Bureau  of  Educational  Research,  1958. 

This  book  presents  and  compares  data  obtained  in  various 
readability  measurement  studies  using  different  readability 
formulas.  Differences  in  results  are  discussed,  as  are 
possible  reasons  to  account  for  the  differences. 

Dale,  Edgar  and  Chall,  Jeanne  S.,  A Formula  for  Predicting 
Readability:  Instructions.  EDUCATIONAL  RESEARCH  BULLETIN, 
February  18,  1948,  pp . 37-54. 

This  article  provides  guidelines  for  applying  the 
Dale-Chall  readability  formula  and  includes  the  Dale  List 
of  3000  Familiar  Words. 

Dale,  Edgar  and  Hager,  Hilda,  How  to  Write  to  Be  Understood, 
EDUCATIONAL  RESEARCH  BULLETIN,  November  10,  1948,  pp . 207-216. 

An  article  that  discusses  seven  techniques  necessary  for 
readable  writing.  This  article  resulted  from  the  authors' 
research  into  writing  understandably  for  health  materials. 
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Flesch,  Rudolf  F.,  THE  ART  OF  READABLE  WRITING,  New  York: 

Harper  & Row  Publishers,  1949. 

The  last  chapter  of  the  book  provides  instructions  for 
applying  Flesch 's  fomula  for  measuring  reading  ease. 

In  the  ranainder  of  the  book  the  author  discusses 
techniques  for  writing  in  a clear  manner  and  provides 
excimples  of  effective  writing  styles. 

Flesch,  Rudolf.  HOW  TO  BE  BRIEF:  AN  INDEX  TO  SIMPLE  WRITING, 

New  York:  Harper  & Row  Publishers,  1962. 

The  author  presents  an  extensive  listing  of  words  which 
are  difficult  or  over-used  and  suggests  possible  alter- 
natives to  these  words. 

Forbes,  Fritz  W.  and  Cottle,  William  C.,  A New  Method  for 
Determining  Readability  of  Standardized  Tests.  THE  JOURNAL 
OF  APPLIED  PSYCHOLOGY,  vol.  37,  no. 3,  1953,  pp . 185-190. 

This  article  discusses  the  development  and  applications 
of  the  Forbes-Cottle  formula,  a readability  measure 
designed  specifically  for  standardized  test  materials. 

GUIDE  FOR  AIR  FORCE  WRITING,  Washington,  D.C.:  Department 
of  the  Air  Force,  1969. 

This  handbook  discusses  many  of  the  basic  mechanics  of 
effective  writing,  including  organization,  English  greutmiar, 
sentence  and  paragraph  structure,  etc.  Much  of  the 
content  is  directed  specifically  to  military  writing. 

Gunning,  Robert.  THE  TECHNIQUE  OF  CLEAR  WRITING  (rev.  ed.) 

New  York:  McGraw-Hill  Book  Co.,  1968. 

The  author  provides  instructions  for  applying  his  Fog 
Index  to  measure  readability.  He  also  gives  ten 
"principles  of  clear  writing"  and  discusses  means  of 
improving  the  readability  of  technical  writing.  Appendix  C 
suggests  possible  substitutes  for  polysyllabic,  unfamiliar 
words . 

Klare,  George  R..  THE  MEASUREMENT  OF  READABILITY,  Ames,  Iowa: 
Iowa  State  University  Press,  1963. 

The  author  presents  information  on  the  development  and 
use  of  various  readability  formulas,  compares  their 
applications  and  in  some  instances  comments  on  their 
effectiveness.  Limitations  of  readability  formulas  in 
general  are  discussed,  and  an  extensive  readability 
bibliography  is  provided. 


Mayo,  Clyde  C.,  THREE  STUDIES  OF  JOB  INVENTORY  PROCEDURES: 
SELECTING  DUTY  AREAS,  INTERVIEWING  AND  SAMPLING,  AFHRL- 
TR-69-32,  Lackland  Air  Force  Base,  Texas:  Personnel  Research 
Division,  November  1969. 

This  study  examines  the  categorization  of  tasks  into 
various  formats. 

McLaughlin,  G.  Harry,  SMOG  Gradinq-A  New  Readability  Formula. 
JOURNAL  OF  READING,  May  1969,  pp . 639-645. 

The  author  discusses  the  development  of  his  SMOG  read- 
ability formula  and  gives  instructions  for  its  use. 

Murphy,  Walter  F.,  THE  APPLICATION  OF  READABILITY  PRINCIPLES 
TO  THE  WRITING  OF  TASK  STATEMENTS:  EFFECTS  ON  RELIABILITY  OF 
JOB  INCUMBENT  RESP(WSES,  Unpublished  Ph.D.  thesis,  Purdue 
University,  1966. 

This  study  was  designed  to  determine  whether  there  are 
significant  differences  in  job  incumbent  responses  to 
two  forms  of  task  statements  when  they  are  modified 
according  to  readability  principles. 

Sticht,  Thomas  S.,  LITERACY  DEMANDS  OF  PUBLICATIONS  IN  SELECTED 
MILITARY  OCCUPATIONAL  SPECIALTIES,  Professional  Paper  25-70, 
Human  Resources  Research  Organization,  October  1970. 

This  paper  is  described  in  the  preface  as  being:  "Of 
concern  is  the  reading  difficulty  level  of  Army  publi- 
cations in  five  Military  Occupational  Specialties,  and 
discrepancies  between  the  difficulty  levels  of  the 
publications  and  the  reading  abilities  of  men  in  the  MOSs. 

Sticht,  Thomas  S.  ed . , READING  FOR  WORKING:  A FUNCTIONAL 
LITERACY  ANTHOLOGY,  Alexandria,  Virginia:  Human  Resources 
Research  Organization,  1975. 

This  book  presents  the  research  HUMRRO  has  done  on 
literacy  in  relation  to  work.  It  is  also  a collection 
of  the  results  of  their  work  for  application  in  education 
and  training  activities  as  well  as  in  development  of  job 
materials . 

Sticht,  Thomas  S.  and  others,  PROJECT  REALISTIC:  DETERMINATION 
OF  ADULT  FUNCTIONAL  LITERACY  SKILL  LEVELS,  Professional  Paper 
20-72,  Human  Resources  Research  Organization,  September  1972. 

The  abstract  for  this  paper  reads:  "...PROJECT  REALISTIC: 
a project  to  determine  functional  literacy  levels  for 
selected  military  jobs  having  civilian  counterparts; 

Cooks,  Vehicle  Repairmen,  Supply  Clerks  and  Armor  Crewmen. 
Implications  of  the  results  for  the  establishment  of 
functional  literacy  levels  for  adult  basic  literacy  train- 
ing are  discussed. 
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APPENDIX  A 


INSTRUCTIONS  FOR  PREPARING  MINI -BOOKLETS* 


Purpose:  To  permit  Marine  Respondents  to  task  inventory 

questionnaires  to  respond  to  a reduced  number  of 
task  statements. 

Background:  Under  traditional  procedures,  the  Marine  respondent 

to  task  inventory  questionnaires  must  respond  to 
all  task  statements  that  may  range  from  as  low  as 
200  to  as  many  as  1000  items.  The  mini-booklet 
procedure  permits  the  Marine  respondent  to  respond 
to  a reduced  number  of  task  statements,  the  number 
depending  upon  the  number  of  mini-booklets  chosen 
by  the  Task  Analyst.  Thus  the  time  required  to 
complete  the  inventory  is  greatly  reduced.  This 
should  reduce  any  effects  of  tediousness,  dis- 
affection, inattention,  response  sets,  or  other 
forms  of  malingering  that  are  related  to  the  length 
of  the  questionnaire. 

PROCEDURES 


Booklet  Preparation 

Procedures  are  supplied  for  splitting  the  task  inventory 
questionnaire  into  6,  10,  15,  or  30  booklets. 

1.  Procedures  for  6 booklets: 

a.  Divide  the  total  set  of  task  statements  into  4 equally- 
sized  groups. 

b.  Number  the  groups  1 through  4. 

c.  Assign  the  groups  to  the  6 booklets  according  to 
Figure  1. 

d.  Thus,  group  1 will  beccxne  part  of  booklets  1,  2,  and  3; 
group  2,  part  of  booklets  1,  4,  and  5;  etc. 

e.  As  a result  of  this  assignment , each  booklet  will  be 
made  up  from  2 groups,  and  no  booklet  will  contain  the 
same  2 groups. 

f.  N per  task  statement  = .5  x the  total  number  of 
respondents;  that  is,  the  number  of  respondents  per 
task  statement  = 50%  of  the  total  number  of  respondents. 


* Based  partly  upon  Dermen,  Diran;  French,  John  W. ; and 

Harman,  Harry  H.,  VERIFICATION  OF  SELF-REPORT  TEMPERAMENT 
FACTORS,  December,  1974,  Technical  Report  No.  6,  Research 
Sponsored  by  the  Office  of  Naval  Research . 


GROUPS  ••  GROUPS 


1 


BOOKLETS 

1 2 3 4 5 6 


Fig.  1:  Four  Groups  Distributed  in  Six  Booklets 


Five  Groups  Distributed  in  Ten  Booklets 
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Six  Groups  Distributed  in  Fifteen  Booklets 


2.  Procedures  for  10  booklets: 
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a . 

Divide  the  total  set  of  task  statements  into  5 
equally-sized  groups. 

b. 

Number  the  groups  1 through  5. 

c . 

Assign  the  groups  to  the  10  booklets  according  to 

Figure  2 . 

d. 

Thus,  group  1 will  become  part  of  booklets  1,  2,  3, 
and  4;  group  2,  part  of  booklets  1,  5,  6,  and  7;  etc. 

e . 

As  a result  of  this  assignment,  each  booklet  will  be 
made  up  from  2 groups,  and  no  booklet  will  contain 
the  same  2 groups. 

f . 

N per  task  statement  * .4  x total  number  of  respondents; 
that  is,  the  nvimber  of  respondents  per  task  statanent  = 
40%  of  the  total  number  of  respondents. 

3.  Procedures  for  15  booklets: 


a . 

Divide  the  total  set  of  task  statements  into  6 
equally-sized  groups. 

b. 

Number  the  groups  1 through  6. 

c . 

Assign  the  groups  to  the  15  booklets  according  to 

Figure  3. 

d. 

Thus,  group  1 will  become  part  of  booklets  1,  2,  3,  4, 
and  5;  group  2,  part  of  booklets  1,  6,  7,  8,  and  9;  etc. 

e. 

As  a result  of  this  assignment,  each  booklet  will  be 
made  up  of  2 groups  of  task  statements  and  no  booklet 
will  contain  the  same  2 groups. 

f . 

N per  task  statement  = .333  x total  number  of  respondents 
that  is,  the  number  of  respondents  per  task  statement  = 

33  1/3X  of  the  total  number  of  respondents. 

4.  Procedures  for  30  booklets: 


a . 

Divide  the  total  set  of  task  statements  into  25 
equally-sized  groups. 

b. 

Number  the  groups  1 through  25. 

c . 

Assign  the  groups  to  the  30  booklets  according  to 

Figure  4. 

d. 

Thus,  group  1 will  become  part  of  booklets  1,  2,  3, 

4,  5,  and  6;  group  2,  part  of  booklets  1,  7,  8,  9, 

10,  and  11;  etc. 

1 

2 

3 

4 

5 

6 

7 

6 

S 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 
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BOOKLETS 


1 2 3 4 5 b 7 8 9 i:>  11  12  13  14  15  16  17  18  19  20  21  22  23  24  25  26  27  28  29  30 
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Fig.  4:  Twenty-five  Groups  Distributed  in  Thirty  Booklets 
Source:  Derman,  op .cit ♦ p.  4 
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e.  As  a result  of  this  assignment,  each  booklet  will  be 
made  up  from  5 groups,  and  no  booklet  will  contain 
the  same  5 groups. 

f.  N per  task  statement  = .2  x total  n\amber  of  respondents 
that  is,  the  number  of  respondents  per  task  statement  = 
20%  of  the  total  number  of  respondents . 

Administration  of  the  Mini-Booklet  Task  Inventory  Questionnaire. 

1.  Number  the  booklets  as  follows: 

a.  For  the  6 booklet,  1 through  6. 

b.  For  the  10  booklet,  1 through  10. 

c.  For  the  15  booklet,  1 through  15. 

d.  For  the  30  booklet,  1 through  30. 

2.  Divide  the  total  number  of  respondents  by  the  number  of 
booklets . 

Excimple:  For  600  respondents  and  6 booklets,  600  4-  6 = 100 

3.  Administer  that  number  of  each  booklet  to  the  respondents. 

In  the  above  example:  100  of  the  respondents  will  get 
booklet  1,  100  will  get  booklet  2,  etc. 

Statistical  Analysis 

1.  Total  sample  size  (N)  = total  number  of  respondents. 

2.  Task  statement  sample  size  (n)  is  as  follows: 

a.  For  the  6 booklet,  .5N. 

b.  For  the  10  booklet,  .4N. 

c.  For  the  15  booklet,  .333  N. 

d.  For  the  30  booklet,  .2N. 

3.  In  compiling  the  data: 

a.  Retain  the  original  task  statement  nvimber,  or 

b.  Prepare  a simple  code  for  each  of  the  booklets. 

4.  Then  apply  standard  statistical  analysis  procedures. 


APPENDIX  B 


MEASURES  OF  READABILITY  USED  IN 
EVALUATING  TASK  INVENTORIES 


82 


APPENDIX  B 

MEASURES  OF  READABILITY  USED  IN 
EVALUATING  TASK  INVENTORIES 


Dale-Chall  Formula: 

Criteria:  average  sentence  length 

percentage  of  unfamiliar  words  not  on  Dale-Chall  list  of  3,000 
fcimiliar  words 

Formula:  (.0496  x average  sentence  length)  + (.1579  x % unf2miiliar 

words)  + 3.6365  = Raw  Score 

Raw  Score  is  then  converted  to  school  grade  level  by  using  the  following 

table: 


# 


Raw  Score 

4.9  and  below 

5.0  to  5.9 

6.0  to  6.9 

7.0  to  7.9 

8.0  to  8.9 
9.0-to  9.9 

10.0  and  above 

Sanpling  techniques  recommended  by 


Corrected  Grade  Level 

Grade  IV  and  below 

Grades  V-VI 

Grades  VII-VIII 

Grades  IX-X 

Grades  XI-XII 

Grades  XIII-XV  (college) 

Grade  XVI  + (college  graduate) 

Dale  and  Chall: 


1.  Sample  Selection:  Books — take  approximately  100  words  about  every 
tenth  page.  Articles — select  about  four  100-word  samples  per  2,000 
v/ords.  Space  the  samples  evenly.  For  passages  of  about  200  to  300 
words,  analyze  the  entire  passage.  Never  begin  or  end  a seunple  in  the 
middle  of  a sentence. 

2.  Word  count:  Count  the  total  number  of  words  in  the  sample,  counting 
as  one  word,  (a)  hyphenated  words  and  contractions,  (b)  compound  names 
of  persons  and  places,  and  (c)  initials  which  are  part  of  a name. 

3.  Average  sentence  length:  Count  the  number  of  complete  sentences  in  the 
sample  and  divide  this  into  the  number  of  words. 

4.  Count  of  unfamiliar  words:  Count  all  words  as  unfconiliar  which  do  not 
appear  on  the  Dale  List  of  3,000  Familiar  Words  (see  Appendix  D) . 

5.  Special  rules  for  the  word  count  and  the  count  of  unfamilietr  words: 

A.  Common  Nouns: 

(1)  Consider  familiar  all  regular  plurals  and  possessives  of  words 
on  the  list. 
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(2)  Count  irregular  plurals  as  unfamiliar,  even  if  the  singular 
form  appears  on  the  list. 

(3)  Count  as  unfamiliar  a noun  that  is  formed  by  adding  ejr  or  r^ 
to  a noun  or  verb  appearing  on  the  word  list  (unless  the  e£ 
or  r form  is  indicated  on  the  list) . 


B. 


Proper  Nouns: 

(1)  Names  of  persons  and  places  are  considered  familiar. 


(2)  Names  of  orgamizations,  laws,  documents,  titles  of  books, 
movies,  and  so  on  generally  comprise  several  words. 

a.  For  the  total  word  count  each  word  is  counted  no  matter 
how  many  times  the  naune  is  repeated  in  the  sample. 

b.  For  the  unfcuailiar  word  count,  consider  unfcimiliar  only 
words  which  do  not  appear  on  the  Dale  list,  except  names 
of  persons  or  places.  Chicago  Building  Association  is 
counted  one  unfamiliar  word — TVssociation,  Building  and 
Chicago  are  faoniliau:.  Declaration  of  Independence  is 
counted  as  two  unfamiliau:  words — is  on  the  list.  If 

a name  of  an  organization,  etc.,  is  used  more  than  twice, 
count  it  only  twice  when  making  the  unfamiliar  word  count. 


(3) 


Abbreviations : 

a.  For  the  total  word  count  an  abbreviation  is  counted  as 

one  word,  and  each  repeat  use  within  the  saunple  is  counted. 


b.  For  the  unfamiliar  word  count  the  abbreviation  is  counted 
as  one  word,  but  for  repeated  uses  over  two  times  within 
the  sample  the  abbreviation  is  given  a count  of  two  un- 
familiar words. 


C.  Verbs: 

(1)  Consider  familiar  the  third-person  plural  forms,  present- 

participle  forms,  past-participle  forms.,  and  past-tense  forms, 
when  these  are  added  to  verbs  on  the  list. 


(2) 


The  same  rule  applies  when  a consonant  is  doubled  before 
adding  ing  or  ed. 


D.  Adjectives: 

(1)  Comparatives  and  superlatives  of  adjectives  appearing  on  the 
list  are  considered  familiar. 

(2)  Adjectives  formed  by  adding  N to  a proper  noun  are  familiar. 

(3)  Count  as  unfamiliar  an  adjective  that  is  formed  by  adding 

^ to  a word  that  appeaurs  on  the  list.  But  consider  the  word 
f2aniliar  if  ^ appears  in  parentheses  following  the  word. 


E. 


Adverbs : 

(1)  Consider  adverbs  famiiliar  which  are  formed  by  adding  to 
a word  on  the  list. 
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(2)  Count  as  unfauniliar  words  which  add  more  than  like  easily, 

F.  Hyphenated  Words:  Count  hyphenated  words  as  unfamiliar  if  either 
word  in  the  compound  does  not  appear  on  the  word  list.  When  both 
appear  on  the  list,  the  word  is  familiar. 

G.  Miscellaneous  Special  Cases: 

(1)  Words  formed  by  adding  en  to  a word  on  the  list  (unless  the 
en  is  listed  in  parentheses  or  the  word  itself  appears  on 
the  list)  are  considered  unfamiliar. 

(2)  Count  a word  unfamiliar  if  two  or  more  endings  are  added  to 
a word  on  the  list. 

(3)  Words  on  the  list  to  which  -tion,  -ation,  -ment , and  other 
suffixes  not  previously  mentioned  are  added  are  considered 
unfamiliar,  unless  the  word  with  the  ending  is  included  on 
the  list. 

6.  Per  cent  unfamiliar  words:  Divide  the  number  of  unf^uniliar  words  in 
the  scunple  by  the  total  word  count  and  multiply  by  100. 


Flesch  Formula: 

• Criteria:  average  sentence  length  and  number  of  syllables  per  100  words 

Formula:  206.835  - (1.015  x average  sentence  length)  - (.846  x nxjmber 

of  syllables  per  100  words)  » Reading  Ease  Score 

Reading  Ease  Score  is  converted  to  school  grade  level  by  means  of  the 
® following  table: 


Reading  Ease  Score 

School  Grade  Level 

90  to  100 

5th  grade 

• 

80 

to 

90 

6th  grade 

70 

to 

80 

7th  grade 

60 

to 

70 

8th  or  9th  grade 

50 

to 

60 

10th  to  12th  grade 

• 

30 

to 

50 

13th  to  16th  grade 

0 

to 

30 

College  graduate 

Sampling  techniques  reconmended  by  Flesch: 

1.  Number  of  samples:  3 to  5 for  an  article,  25  to  30  for  a book. 

2.  Scunple  selection:  Eliminate  first  paragraph,  then  select  paragraphs 
mathematically,  such  as  every  third  paragraph  or  the  second  paragraph 
of  every  third  page. 


85 


3.  Sentence  selection:  Choose  the  sentences  using  the  first  100  words 
(or  closest  thereto)  of  the  paragraphs  selected. 

4.  Average  sentence  length:  Count  the  sentences  selected  from  all  samples 
used.  Count  the  words  in  thse  sentences.  Average  sentence  length  * 
total  words  in  sentences  selected  ^ number  of  sentences  selected. 

5.  Number  of  syllables  per  100  words;  Count  the  number  of  syllables  in 
all  of  the  samples  selected  and  divide  by  the  total  number  of  words 
in  the  samples. 


FOG  Index; 

Criteria:  average  sentence  length  and  percentage  of  polysyllable  words 

Formula:  (average  sentence  length  + % polysyllable  words)  x .4  * School 

grade  level 


Sampling  techniques  recommended  by  Gunning: 

1.  Sample  selection;  Select  several  100  word  samples  spaced  evenly  through 
the  piece. 

2.  Average  sentence  length.  Count  the  nunfcer  of  sentences  in  each  of  the 
100  word  samples,  including  the  sentence  ending  closest  to  the  100 
words.  Count  the  words  in  all  the  sentences.  Average  sentence  length  * 
number  of  all  words  in  the  samples  t nvimber  of  all  sentences  in  the 
samples. 


3.  Per  cent  of  polysyllable  words : Count  the  number  of  words  of  three  or 
more  syllables  in  the  seutples  selected  and  divide  by  the  total  number 
of  words  in  the  samples.  Do  not  count  words  that  are:  (a)  proper 
names,  (b)  combinations  of  short  easy  words  (like  "bookkeeper"  and 
"manpower") , (c)  verb  forms  made  three  syllables  by  adding  -ed  or 
-es  (like  "created"  or  "trespasses"). 


S[40G  Grading: 

Criterion:  number  of  polysyllable  words  in  a 30“sentence  sample 

Formula:  square  root  of  the  number  of  polysyllable  words  in  sample 

(rounded  to  nearest  perfect  square)  + 3.0  * School  grade  level 

Sampling  techniques  recommended  by  McLaughlin: 

1.  Sample  selection;  Count  10  consecutive  sentences  near  the  beginning 

of  the  text,  10  in  the  middle,  and  10  near  the  end.  Count  as  a sentence 
any  string  of  words  ending  with  a period,  question  mark,  or  exclamation 
point. 

2.  Number  of  polysyllable  words  in  the  30  sentence  sample:  Count  every  word 
of  three  or  more  syllables.  Any  string  of  letters  or  numerals  beginning 
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and  ending  with  a space  or  punctuation  mark  should  be  counted  if  you 
can  distinguish  at  least  three  syllables  when  you  read  it  aloud  in  con- 
text. If  a polysyllabic  word  is  repeated,  count  each  repetition. 

3.  Estimating  the  square  root  of  the  number  of  polysyllabic  words  counted: 

This  is  done  by  tciking  the  square  root  of  the  nearest  perfect  square. 
For  example,  if  the  count  is  95,  the  nearest  perfect  square  is  100, 
which  yields  a square  root  of  10.  If  the  count  lies  roughly  between 
two  perfect  squares,  choose  the  lower  number.  For  instance,  if  the 
count  is  110,  take  the  square  root  of  100  rather  than  that  of  121. 


Forbes-Cottle  Method: 

Criteria:  arbitrary  selection  of  difficult  words  in  sample  that  had  weight 

of  4 or  more  in  the  Thorndike  Century  Junior  Dictionary 

Formula:  sum  the  weights  of  the  difficult  words  ^ number  of  words  in 

sample  * index  of  vocabulary  difficulty 

Indices  are  converted  into  school  grade  level  by  means  of  the  following 
table: 

Index  of  Vocabulary 

Difficulty  Grade  Level 


1.4510  cind  above 

College 

1.2510-1.4509 

12th 

grade 

1.0510-1.2509 

11th 

grade 

.8510-1.0509 

10th 

grade 

.6510-  .8509 

9th 

grade 

.4510-  .6509 

8th 

grade 

.2510-  .4509 

7th 

grade 

.0510-  .2509 

6th 

grade 

.0509  £uid  below 

5th 

grade 

Sampling  techniques  recommended  by  Forbes  and  Cottle: 

1.  Nxamber  of  samples:  Take  three  samples  of  100  words  each. 

2.  Sample  selection:  Begin  with  the  first  word  of  the  first  item  of  the 
selection  to  be  tested  and  count  the  first  hundred. word  sample  exactly. 
The  middle  sample  is  selected  as  near  the  midpoint  of  the  test  item  as 
possible.  Starting  with  the  middle  word,  count  backword  fifty  words. 
Using  that  word  as  a starting  place  count  100  words  exactly.  The  third 
Scunple  is  taken  by  counting  backwards  100  words  from  the  last  word  of 
the  selection  to  be  tested. 

3.  Sum  of  weights  of  the  difficult  words;  The  weights  of  all  words  in 
the  three  samples  having  a weighting  as  given  in  the  1942  Thorndike 
Junior  Century  Dictionary  of  4 or  greater  are  summed. 
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4.  Number  of  words  in  the  sample;  Three  samples  of  exactly  100  words  each 
equals  300  words, 

FORCAST  readability  in  reading  grade  level  (RGL) : 

Criteria:  count  the  number  of  one-syllable  words  in  a 150-word  passage 
divide  that  number  by  10  and  subtract  that  value  from  20 

Formula:  20  - nunfeer  of  one-syllable  words  * RGL 

10 


RGL:  Reading  grade  level 

Sampling  techniques  recommended  by  Cay lor,  Sticht,  Fox,  and  Ford: 

1.  Applicability  of  FORCAST:  FORCAST  is  designed  primarily  for  use  on 
military  regulations  and  manuals. 

2.  Scunple  selection:  Passages  are  deemed  appropriate  if  they  contain 
150  words  of  prose  (excluding  tables)  on  either  one  subject  or  two 
closely  related  subjects.  Passages  should  also  be  selected  to  repre- 
sent the  MOS  under  study. 

3.  Number  of  one-syllable  words;  The  number  of  one-syllable  words  in  the 
150  word  sample  is  counted.  Syllabification  is  determined  by  the  spoken 
language;  for  example  the  number  14  is  treated  as  the  two-syllable 

word  ”four-teen.  Hyphenated  words  are  treated  as  a single  word, 
and  are  considered  polysyllabic.  In  case  of  doubt,  a dictionary  is 
to  be  consulted. 


APPENDIX  C 


AN  EXPLANATION  OF  THE  WEIGHTINGS  USED  IN 
THE  THORNDIKE  CENTURY  JUNIOR  DICTIONARY 
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APPENDIX  C 

AN  EXPLANATION  OF  THE  WEIGHTINGS  USED  IN 
THE  THORNDIKE  CENTURY  JUNIOR  DICTIONARY 


The  Forbes-Cottle  method  of  determining  readability 
difficulty  relies  upon  the  word  frequency  weightings  used  in 
Thorndike  Century  Junior  Dictionary.  These  numbers  tell  how 
widely  used  the  word  is.  "1  means  that  the  word  is  one  of  the 
• thousand  most  widely  used  words;  2 means  that  the  word  is  one 

of  the  next  most  widely  used  thousand;  3 means  that  the  word 
is  in  the  third  thousand;  and  so  onto  20  for  the  twentieth 
thousand...  The  meanings  of  the  number  1 to  20  in  terms  of 
occurrences  per  million  words  are  approximately  as  follows: 


Successive  Number  of  occurrences  of 

Thousands  each  word  per  million  words 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 


a 

a 


100  or  more 
55  to  99 
35  to  54 
27 
20 
15 
12 
9 
6 
4 

3J5 

3 + 

2 2/3 
2 1/3 
2 

1 3/4 

1*5 

1*3 

little  over 
little  under 


1 per  million 
1 per  million 


1.  Thorndike,  E.L.,  TH(»NDI1CE  CENTURY  JUNIOR  DICTIONARY  (rev.  ed.). 
New  York;  Scott, Foresman  and  Company,  1942. 
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A word  numbered  10  will  thus  on  the  average  occur  twice  as 
often  as  one  numbered  15;  a word  numbered  15  will  on  the 
average  occur  twice  as  often  as  one  numbered  20.  "Whenever 
there  is  need  to  know  how  often  a word  is  used  in  print, 
these  numbers  are  the  best  guide  now  available."  ^ 

For  instance,  the  word  auxiliary  has  a weight  designation 
of  10,  as  opposed  to  the  word  opportunity,  which  has  a weight- 
ing of  2.  The  following  list  is  provided  as  a sample  of 
various  words  and  the  frequency  weights  given  them.  The  words 
used  in  this  exaunple  were  selected  from  task  inventories  for 
Occupational  Field  44  (Legal  Services)  and  OF  13  (Construction, 
Equipment  and  Shore  Party) . 


Perform 

1 

Draft 

3 

Description 

3 

Instructions 

3 

Reconcile 

4 

Inquiries 

5 

Interview 

5 

Install 

5 

Accurately 

7 

Participate 

7 

Coordinate 

9 

Transcribe 

12 

Proceedings 

13 

Fabricate 

14 

Ensure 

17 

Questionnaire^ 

No  : 

Punitive  r 

Evaluate  J 

are 

fori 

That  is,  these  words 


2.  Ibid . , p.  xiii-xiv. 
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WE  WANT  TO  KNOW  HOW  YOU  FEEL  ABOUT  TOE  INVENTORY  YOU  JUST  TOOK! 
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Please  use  this  page  to  make  any  other  comments  you  have  about  the  inventory 
and  its  administration. 
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DALE  LIST  OF  FAMILIAR  WORDS 


Although  the  Dale  list  of  familiar  words  contains  many 
words  that  are  not  likely  to  be  used  in  task  statements  for 
Task  Inventories,  it  is  considered  that  within  the  list  are 
a number  of  words  that  may  be  applicable.  Perhaps  the  greatest 
values  of  the  list  may  be  found  in  preparation  of  instructions 
for  Task  Inventories  and  in  helping  writers  of  task  statements 
to  focus  upon  the  simplest  words  that  can  be  used  and  still 
maintain  precision  in  the  statements. 

A description  by  Dale  and  Chall  of  development  of  the  list, 
cautions  in  its  use,  and  the  list  itself  follow;  "The  Dale 
list  of  approximately  three  thousand  familiar  words  represents 
words  that  are  known  in  reading  by  at  least  80  per  cent  of 
the  children  in  Grade  IV.  It  is  presented  primarily  as  a 
list  which  gives  a significant  correlation  with  reading  dif- 
ficulty. It  is  not  intended  as  a list  of  the  most  important 
words  for  children  or  adults.  It  includes  words  that  are 
relatively  unimportant  and  exludes  some  important  ones.  To 
use  the  list  for  more  than  an  over-all  statistical  device 
which  gives  a good  prediction  of  readability  would  be  out 
of  harmony  with  the  purpose  for  which  it  was  constructed. 

"The  technique  used  for  constructing  the  list  was  crude. 
When  80  per  cent  of  the  fourth-graders  questioned  indicated 
that  they  knew  a word,  that  word  was  included  in  the  list. 

This  arbitary  cutting  off  at  the  80-per  cent  point  and  the 
lack  of  any  measure  of  the  importance  of  these  words  make 
exceedingly  dubious  the  wisdom  of  using  individual  words  in 
appraising  the  ease  or  difficulty  of  material.  For  purposes 
of  computing  a level  of  difficulty,  however,  the  percentage 
of  words  outside  this  list  is  a very  good  index  of  the 
difficulty  of  reading  materials.  The  terms  familiar  and 
unfamiliar  describing  words  are  therefore  used  here  in  a 
statistical  sense. 


1.  Dale,  Edgar  and  Chall,  Jeanne  S.,  A Formula  for  Predicting 
Readability;  Instructions.  EDUCATIONAL  RESEARCH  BULLETIN, 
February  18,  1948,  pp.  44-54. 
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a 

air 

able 

airfield 

aboard 

airport 

about 

airplane 

above 

airship 

absent 

airy 

accept 

alarm 

accident 

alike 

account 

alive 

ache  (ing) 

all 

acorn 

alley 

acre 

alligator 

across 

allow 

act (s) 

almost 

add 

alone 

address 

along 

admire 

aloud 

adventure 

already 

afar 

also 

afraid 

always 

after 

am 

afternoon 

America 

afterward (s) 

American 

again 

eunong 

against 

amount 

age 

an 

aged 

and 

ago 

angel 

agree 

anger 

ah 

angry 

ahead 

animal 

aid 

another 

aim 

answer 

ant 

ask 

any 

asleep 

anybody 

at 

anyhow 

ate 

anyone 

attack 

anything 

attend 

anyway 

attention 

anywhere 

August 

apart 

aunt 

apartment 

author 

ape 

auto 

apiece 

automobile 

appear 

autvimn 

apple 

avenue 

April 

awake (n) 

apron 

away 

are 

awful (ly) 

aren ' t 

awhile 

arise 

ax 

arithmetic 

baa 

arm 

babe 

armful 

baby (ies) 

army 

back 

arose 

background 

around 

backward (s) 

arrange 

bacon 

arrive (d) 

bad (ly) 

arrow 

badge 

art 

bag 

artist 

bake(r) 

as 

baking 

ash (es) 

bakery 

aside 

ball 
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balloon 

beefsteak 

banana 

beehive 

band 

been 

bandage 

beer 

bang 

beet 

banjo 

before 

banker (er) 

beg 

bar 

began 

barber 

beggar 

bare (ly) 

begged 

barefoot 

begin 

bark 

beginning 

barn 

begun 

barrel 

behave 

base 

behind 

baseball 

believe 

basement 

bell 

basket 

belong 

bat 

below 

batch 

belt 

bath 

beneath 

bathe 

bench 

bathing 

bend 

bathroom 

bent 

bathtub 

berry  (ies) 

battle 

beside (s) 

battleship 

best 

bay 

bet 

be  (ing) 

better 

beach 

between 

bead 

bib 

beam 

bible 

bean 

bicycle 

bear 

bid 

beard 

big(ger) 

beast 

bill 

beat (ing) 

billboard 

beautiful 

bin 

beautify 

bind 

beauty 

bird 

bec2une 

birth 

because 

birthday 

become 

biscuit 

becoming 

bit 

bed 

bite 

bedbug 

biting 

bedroom 

bitter 

bedspread 

black 

bedtime 

blackberry 

bee 

blackbird 

beech 

blackboard 

beef 

blackness 

blacksmith 

boxcar 

blame 

boxer 

blank 

boy 

blanket 

boyhood 

blast 

bracelet 

blaze 

brain 

bleed 

brake 

bless 

bran 

blessing 

branch 

blew 

brass 

blind (s) 

brave 

blindfold 

bread 

block 

break 

blood 

breakfast 

bloom 

breast 

blossom 

breath 

blot 

breathe 

blow 

breeze 

blue 

brick 

blueberry 

bride 

bluebird 

bridge 

blue  jay 

bright 

blush 

brightness 

board 

bring 

boast 

broad 

boat 

broadcast 

bob 

broke (n) 

bobwhite 

brook 

body (ies) 

broom 

boil (er) 

brother 

bold 

brought 

bone 

brown 

bonnet 

brush 

boo 

bubble 

book 

bucket 

bookcase 

buckle 

bookkeeper 

bud 

boom 

buffalo 

boot 

bug 

born 

buggy 

borrow 

build 

boss 

building 

both 

built 

bother 

bulb 

bottle 

bull 

bottom 

bullet 

bought 

bum 

bounce 

bumblebee 

bow 

bump 

bowl 

bun 

bow-wow 

bunch 

box (es) 

bund le 

99 


bunny 

captain 

burn 

car 

burst 

card 

bury 

cardboard 

bus 

care 

bush 

careful 

bushel 

careless 

business 

carelessness 

busy 

carload 

but 

carpenter 

butcher 

carpet 

butt 

carriage 

butter 

carrot 

buttercup 

carry 

butterfly 

cart 

buttermilk 

carve 

butterscotch 

case 

button 

cash 

buttonhole 

cashier 

buy 

castle 

buzz 

cat 

by 

catbird 

bye 

catch 

cab 

catcher 

cabbage 

caterpillar 

cabin 

catfish 

cabinet 

catsup 

cackle 

cattle 

cage 

caught 

cake 

cause 

calendar 

cave 

calf 

ceiling 

call (er) 

cell 

came 

cellar 

camel 

cent 

camp 

center 

campfire 

cereal 

can 

certain (ly) 

canal 

chain 

canary 

chair 

candle 

chalk 

candlestick 

champion 

candy 

chance 

cane 

change 

cannon 

chap 

cannot 

charge 

canoe 

charm 

can ' t 

chart 

canyon 

chase 

cap 

chatter 

cape 

cheap 

capital 

cheat 

check 

close 

checkers 

closet 

cheek 

cloth 

cheer 

clothes 

cheese 

clothing 

cherry 

cloud (y) 

chest 

clover 

chew 

clown 

chick 

club 

chicken 

cluck 

chief 

clump 

child 

coach 

childhood 

coal 

children 

coast 

chill (y) 

coat 

chimney 

cob 

chin 

cobbler 

china 

cocoa 

chip 

coconut 

chipmunk 

cocoon 

chocolate 

cod 

choice 

codfish 

choose 

coffee 

chop 

coffeepot 

chorus 

coin 

chose (n) 

cold 

christen 

collar 

Christmas 

college 

church 

color (ed) 

churn 

colt 

cigarette 

column 

circle 

comb 

circus 

come 

citizen 

comfort 

city 

comic 

clang 

coming 

clap 

company 

class 

compare 

classmate 

conductor 

classroom 

cone 

claw 

connect 

clay 

coo 

clean (er) 

cook(ed) 

clear 

cook(ing) 

clerk 

cooky(ie) (s) 

clever 

cool  (er) 

click 

coop 

cliff 

copper 

climb 

copy 

clip 

cord 

cloak 

cork 

clock 

corn 

corner 

cupboard 

correct 

cupful 

cost 

cure 

cot 

curl (y) 

cottage 

curtain 

cotton 

curve 

couch 

cushion 

cough 

custard 

could 

customer 

couldn ' t 

cut 

count 

cute 

counter 

cutting 

country 

dab 

county 

dad 

course 

daddy 

court 

daily 

cousin 

dairy 

cover 

daisy 

cow 

dcun 

coward (ly) 

damage 

cowboy 

dame 

cozy 

damp 

crab 

dance (r) 

crack 

dancing 

cracker 

dandy 

cradle 

danger (ous) 

cramps 

dare 

cranberry 

dark (ness) 

crank (y) 

darling 

crash 

darn 

crawl 

dart 

crazy 

dash 

cream (y) 

date 

creek 

daughter 

creep 

dawn 

crept 

day 

cried 

daybreak 

croak 

daytime 

crook (ed) 

dead 

crop 

deaf 

cross (ing) 

deal 

cross-eyed 

dear 

crow 

death 

crowd (ed) 

December 

crown 

decide 

cruel 

deck 

crumb 

deed 

crumble 

deep 

crush 

deer 

crust 

defeat 

cry (ies) 

defend 

cub 

defense 

cuff 

delight 

cup 

den 

dentist 

dough 

depend 

dove 

deposit 

down 

describe 

downstairs 

desert 

downtown 

deserve 

dozen 

desire 

drag 

desk 

drain 

destroy 

drank 

devil 

draw(er) 

dew 

draw (ing) 

diamond 

dream 

did 

dress 

didn't 

dresser 

die (d)  (s) 

dressmaker 

difference 

drew 

different 

dried 

dig 

drift 

dim 

drill 

dime 

drink 

dine 

drip 

ding-dong 

drive (n) 

dinner 

driver 

dip 

drop 

direct 

drove 

direction 

drown 

dirt (y) 

drowsy 

discover 

drug 

dish 

drum 

dislike 

drunk 

dismiss 

dry 

ditch 

duck 

dive 

due 

diver 

dug 

divide 

dull 

do 

dumb 

dock 

dump 

doctor 

during 

does 

dust  (y) 

doesn ' t 

duty 

dog 

dwarf 

doll 

dwell 

dollar 

dwelt 

dolly 

drying 

done 

each 

donkey 

eager 

don ' t 

eagle 

door 

ear 

doorbell 

early 

doorknob 

earn 

doorstep 

earth 

dope 

east (ern) 

dot 

easy 

double 

eat (en) 
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edge 

explain 

fife 

foam 

egg 

extra 

fifteen 

fog 

eh 

eye 

fifth 

foggy 

eight 

eyebrow 

fifty 

fold 

eighteen 

fable 

fig 

folks 

eighth 

face 

fight 

follow(ing) 

eighty 

facing 

figure 

fond 

either 

fact 

file 

food 

elbow 

factory 

fill 

fool 

elder 

fail 

film 

foolish 

eldest 

faint 

finally 

foot 

electric 

fair 

find 

football 

electricity 

fairy 

fine 

footprint 

elephant 

faith 

finger 

for 

eleven 

fake 

finish 

forehead 

elf 

fall 

fire 

forest 

elm 

false 

firearm 

forget 

else 

family 

firecracker 

forgive 

elsewhere 

fan 

fireplace 

forgot (ten) 

empty 

fancy 

fireworks 

fork 

end  (ing) 

far 

firing 

form 

enemy 

faraway 

first 

fort 

engine 

fare 

fish 

forth 

engineer 

farmer 

fisherman 

fortune 

English 

farm (ing) 

fist 

forty 

enjoy 

far-off 

fit(s) 

forward 

enough 

farther 

five 

fought 

enter 

fashion 

fix 

found 

envelope 

fast 

flag 

fountain 

equal 

fasten 

flake 

four 

erase (r) 

fat 

flame 

fourteen 

errand 

father 

flap 

fourth 

escape 

fault 

flash 

fox 

eve 

favor 

flashlight 

frame 

even 

favorite 

flat 

free 

evening 

fear 

flea 

freedom 

ever 

feast 

flesh 

freeze 

every 

feather 

flew 

freight 

everybody 

February 

flies 

French 

everyday 

fed 

flight 

fresh 

everyone 

feed 

flip 

fret 

everything 

feel 

flip-flop 

Friday 

everywhere 

feet 

float 

fried 

evil 

fell 

flock 

friend (ly) 

exact 

fellow 

flood 

friendship 

except 

felt 

floor 

frighten 

exchange 

fence 

flop 

frog 

excited 

fever 

flour 

from 

exciting 

few 

flow 

front 

excuse 

fib 

flower (y) 

frost 

exit 

fiddle 

flutter 

frown 

expect 

field 

fly 

froze 

fruit 

God  (g) 

guard 

having 

fry 

godmother 

guess 

hawk 

fudge 

gold (en) 

guest 

hay 

fuel 

goldfish 

guide 

hayfield 

full(y) 

golf 

gulf 

haystack 

fun 

gone 

gum 

he 

funny 

good (s) 

gun 

head 

fur 

good-by (bye) 

gunpowder 

headache 

furniture 

good-looking 

guy 

heal 

further 

goodness 

ha 

health  (y) 

fuzzy 

goody 

habit 

heap 

gain 

goose 

had 

hear (ing) 

gallon 

gooseberry 

hadn ' t 

heard 

gallop 

got 

hail 

heart 

game 

govern 

hair 

heat (er) 

gang 

government 

haircut 

heaven 

garage 

gown 

hairpin 

heavy 

garbage 

grab 

half 

he'd 

garden 

gracious 

hall 

heel 

gas 

grade 

halt 

height 

gasoline 

grain 

ham 

held 

gate 

grand 

hammer 

hell 

gather 

granchild 

hand 

he'll 

gave 

grandchildren 

handful 

hello 

gay 

granddaughter 

handkerchief 

helmet 

gear 

grandfather 

handle 

help (er) 

geese 

grandma 

handwriting 

helpful 

general 

grandmother 

hang 

hem 

gentle 

grandpa 

happen 

hen 

gentleman 

grandson 

happily 

henhouse 

gentlemen 

grandstand 

happiness 

her  (s) 

geography 

grape (s) 

happy 

herd 

get 

grapefruit 

harbor 

here 

getting 

grass 

hard 

here ' s 

giant 

grasshopper 

hardly 

hero 

gift 

grateful 

hardship 

herself 

gingerbread 

grave 

hardware 

he's 

girl 

gravel 

hare 

hey 

give (n) 

graveyard 

hark 

hickory 

giving 

gravy 

harm 

hid 

glad(ly) 

gray 

harness 

hidden 

glance 

graze 

harp 

hide 

glass  (es) 

grease 

harvest 

high 

gleam 

great 

has 

highway 

glide 

green 

hasn ' t 

hill 

glory 

greet 

haste (n) 

hillside 

glove 

grew 

hasty 

hilltop 

glow 

grind 

hat 

hilly 

glue 

groan 

hatch 

him 

go(ing) 

grocery 

hatchet 

himself 

goes 

ground 

hate 

hind 

goal 

group 

haul 

hint 

goat 

grove 

have 

hip 

gobble 

grow 

haven  * t 

hire 
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his 

hiss 

history 

hit 

hitch 

hive 

ho 

hoe 

hog 

hold (er) 

hole 

holiday 

hollow 

holy 

home 

homely 

homesick 

honest 

honey 

honeybee 

honeymoon 

honk 

honor 

hood 

hoof 

hook 

hoop 

hop 

hope(ful) 

hopeless 

horn 

horse 

horseback 

horseshoe 

hose 

hospital 

host 

hot 

hotel 

hound 

hour 

house 

housetop 

housewife 

housework 

how 

however 

howl 

hug 

huge 

hum 

humble 

hump 


hundred 

hung 

hunger 

hungry 

hunk 

hunt  (er) 

hurrah 

hurried 

hurry 

hurt 

husband 

hush 

hut 

hymn 

I 

ice 

icy 

I*d 

idea 

ideal 

if 

ill 

I’ll 

I 'm 

important 

impossible 

improve 

in 

inch (es) 

income 

indeed 

Indian 

indoors 

ink 

inn 

insect 

inside 

instant 

instead 

insult 

intend 

interested 

interesting 

into 

invite 

iron 

is 

island 

isn ' t 

it 

its 

it’s 

itself 


I ’ ve 

ivory 

ivy 

jacket 

jacks 

jail 

jam 

January 

jar 

jaw 

jay 

jelly 

jellyfish 

jerk 

jig 

job 

jockey 

join 

joke 

joking 

jolly 

journey 

joy  (ful) 

joyous 

judge 

jug 

juice 

juicy 

July 

jump 

June 

junior 

junk 

just 

keen 

keep 

kept 

kettle 

key 

kick 

kid 

kill(ed) 

kind (ly) 

kindness 

king 

kingdom 

kiss 

kitchen 

kite 

kitten 

kitty 

knee 

kneel 


knew 

knife 

knit 

knives 

knob 

knock 

knot 

know 

known 

lace 

lad 

ladder 

ladies 

lady 

laid 

lake 

lamb 

lame 

lamp 

land 

lane 

language 

lantern 

lap 

lard 

large 

lash 

lass 

last 

late 

laugh 

laundry 

law 

lawn 

lawyer 

lay 

lazy 

lead 

leader 

leaf 

leak 

lean 

leap 

learn (ed) 

least 

leather 

leave (ing) 

led 

left 

leg 

lemon 

lemonade 

lend 
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length 

loop 

mat 

moment 

less 

loose 

match 

Monday 

lesson 

lord 

matter 

money 

let 

lose (r) 

mattress 

monkey 

let's 

loss 

may  (M) 

month 

letter 

lost 

maybe 

moo 

letting 

lot 

mayor 

moon 

lettuce 

loud 

maypole 

moonlight 

level 

love 

me 

moose 

liberty 

lovely 

meadow 

mop 

library 

lover 

meal 

more 

lice 

low 

mean (s) 

morning 

lick 

luck(y) 

meant 

morrow 

lid 

lumber 

measure 

moss 

lie 

lump 

meat 

most (ly) 

life 

lunch 

medicine 

mother 

lift 

lying 

meet (ing) 

motor 

light (ness) 

ma 

melt 

mount 

lightning 

machine 

member 

mountain 

like 

machinery 

men 

mouse 

likely 

mad 

mend 

mouth 

liking 

made 

meow 

move 

lily 

magazine 

merry 

movie 

limb 

magic 

mess 

movies 

lime 

maid 

message 

moving 

limp 

mail 

met 

mow 

line 

mailbox 

metal 

Mr . , Mrs . 

linen 

mailman 

mew 

much 

lion 

major 

mice 

mud 

lip 

make 

middle 

muddy 

list 

making 

midnight 

mug 

listen 

male 

might  (y) 

mule 

lit 

mcima 

mile 

multiply 

little 

mamma 

milk 

murder 

live (s) 

man 

milkman 

music 

lively 

manager 

mill 

must 

liver 

mane 

miller 

my 

living 

manger 

million 

myself 

lizard 

many 

mind 

nail 

load 

map 

mine 

name 

loaf 

maple 

miner 

nap 

loan 

marble 

mint 

napkin 

loaves 

march (M) 

minute 

narrow 

lock 

mare 

mirror 

nasty 

loconotive 

mark 

mischief 

naughty 

log 

market 

miss (M) 

navy 

lone 

marriage 

misspell 

near 

lonely 

married 

mistake 

nearby 

lonesome 

marry 

misty 

nearly 

long 

mask 

mitt 

neat 

look 

mast 

mitten 

neck 

lookout 

master 

mix 

necktie 
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need 

odd 

needle 

of 

needn ' t 

off 

Negro 

offer 

neighbor 

office 

neighborhood 

officer 

neither 

often 

nerve 

oh 

nest 

oil 

net 

old 

never 

oldf ashioned 

nevermore 

on 

new 

once 

news 

one 

newspaper 

onion 

next 

only 

nibble 

onward 

nice 

open 

nickel 

or 

night 

orange 

nightgown 

orchard 

nine 

order 

nineteen 

ore 

ninety 

organ 

no 

other 

nobody 

otherwise 

nod 

ouch 

noise 

ought 

noisy 

our  (s) 

none 

ourselves 

noon 

out 

nor 

outdoors 

north (ern) 

outfit 

nose 

outlaw 

not 

outline 

note 

outside 

nothing 

outward 

notice 

oven 

November 

over 

now 

overalls 

nowhere 

overcoat 

number 

overeat 

nurse 

overhead 

nut 

overhear 

oak 

overnight 

oar 

overturn 

oatmeal 

owe 

oats 

owing 

obey 

owl 

ocean 

own (er) 

o'clock 

ox 

October 

pa 

pace 

peep 

pack 

peg 

package 

pen 

pad 

pencil 

page 

penny 

paid 

peop le 

pail 

pepper 

pain(ful) 

peppermint 

paint (er) 

perfume 

painting 

perhaps 

pair 

person 

pal 

pet 

palace 

phone 

pale 

piano 

pan 

pick 

pancake 

pickle 

pane 

picnic 

pansy 

picture 

pants 

pie 

papa 

piece 

paper 

pig 

parade 

pigeon 

pardon 

piggy 

parent 

pile 

park 

pill 

part (ly) 

pillow 

partner 

pin 

party 

pine 

pass 

pineapple 

passenger 

pink 

past 

pint 

paste 

pipe 

pasture 

pistol 

pat 

pit 

patch 

pitch 

path 

pitcher 

patter 

pity 

pave 

place 

pavement 

plain 

paw 

plan 

pay 

plane 

payment 

plant 

pea(s) 

plate 

peace  (ful) 

platform 

peach (es) 

platter 

peak 

play(er) 

peanut 

playground 

pear 

playhouse 

pearl 

playmate 

peck 

plaything 

peek 

pleasant 

peel 

please 
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pleasure 

proud 

plenty 

prove 

plow 

prune 

plug 

public 

plum 

puddle 

pocket 

puff 

pocketbook 

pull 

poem 

pump 

point 

pumpkin 

poison 

punch 

poke 

punish 

pole 

pup 

police 

pupil 

policeman 

puppy 

polish 

pure 

polite 

purple 

pond 

purse 

ponies 

push 

pony 

puss 

pool 

pussy 

poor 

pussycat 

pop 

put 

popcorn 

putting 

popped 

puzzle 

porch 

quack 

pork 

quart 

possible 

quarter 

post 

queen 

postage 

queer 

postman 

cjuestion 

pot 

quick (ly) 

potato (es) 

quiet 

pound 

quilt 

pour 

quit 

powder 

quite 

power  (ful) 

rabbit 

praise 

race 

pray 

rack 

prayer 

radio 

prepare 

radish 

present 

rag 

pretty 

rail 

price 

railroad 

prick 

railway 

prince 

rain(y) 

princess 

rainbow 

print 

raise 

prison 

raisin 

prize 

rake 

promise 

ram 

proper 

ran 

protect 

ranch 

rang 

ring 

rap 

rip 

rapidly 

ripe 

rat 

rise 

rate 

rising 

rather 

river 

rattle 

road 

raw 

roadside 

ray 

roar 

reach 

roast 

read 

rob 

reader 

robber 

reading 

robe 

ready 

robin 

real 

rock (y) 

really 

rocket 

reap 

rode 

rear 

roll 

reason 

roller 

rebuild 

roof 

receive 

room 

recess 

rooster 

record 

root 

red 

rope 

redbird 

rose 

redbreast 

rosebud 

refuse 

rot 

reindeer 

rotten 

rejoice 

rough 

remain 

round 

remember 

route 

remind 

row 

remove 

rowboat 

rent 

royal 

repair 

rub 

repay 

rubbed 

repeat 

rubber 

report 

rubbish 

rest 

rug 

return 

rule  (r) 

review 

rumble 

reward 

run 

rib 

rung 

ribbon 

runner 

rice 

running 

rich 

rush 

rid 

rust  (y) 

riddle 

rye 

ride  (r) 

sack 

riding 

sad 

right 

saddle 

rim 

sadness 

safe 

see (ing) 

shining 

sixth 

safety 

seed 

shiny 

sixty 

said 

seek 

ship 

size 

sail 

seem 

shirt 

skate 

sailboat 

seen 

shock 

skater 

sailor 

seesaw 

shoe 

ski 

saint 

select 

shoemaker 

skin 

salad 

self 

shone 

skip 

sale 

selfish 

shook 

skirt 

salt 

sell 

shoot 

sky 

same 

send 

shop 

slam 

sand (y) 

sense 

shopping 

slap 

sandwich 

sent 

shore 

slate 

sang 

sentence 

short 

slave 

sank 

separate 

shot 

sled 

sap 

September 

should 

sleep (y) 

sash 

servant 

shoulder 

sleeve 

sat 

serve 

shouldn't 

sleigh 

satin 

service 

shout 

slept 

satisfactory 

set 

shovel 

slice 

Saturday 

setting 

show 

slid 

sausage 

settle 

shower 

slide 

savage 

settlement 

shut 

sling 

save 

seven 

shy 

slip 

savings 

seventeen 

sick(ness) 

slipped 

saw 

seventh 

side 

slipper 

say 

seventy 

sidewa Ik 

slippery 

scab 

several 

sideways 

slit 

scales 

sew 

sigh 

slow(ly) 

scare 

shade 

sight 

sly 

scarf 

shadow 

sign 

smack 

school 

shady 

silence 

small 

schoolboy 

shake (r) 

silent 

smart 

schoolhouse 

shaking 

silk 

smell 

schoolmaster 

shall 

sill 

smile 

schoolroom 

shame 

silly 

smoke 

scorch 

shan ' t 

silver 

smooth 

score 

shape 

simple 

snail 

scrap 

share 

sin 

snake 

scrape 

sharp 

since 

snap 

scratch 

shave 

sing 

snapping 

scream 

she 

singer 

sneeze 

screen 

she'd 

single 

snow(y) 

screw 

she’ll 

sink 

snowball 

scrub 

she ' s 

sip 

snowflake 

sea 

shear (s) 

sir 

snuff 

seal 

shed 

sis 

snug 

seam 

sheep 

sissy 

so 

search 

sheet 

sister 

soak 

season 

shelf 

sit 

soap 

seat 

shell 

sitting 

sob 

second 

shepherd 

six 

socks 

secret 

shine 

sixteen 

sod 

soda 

springtime 

sofa 

sprinkle 

soft 

square 

soil 

squash 

sold 

squeak 

soldier 

squeeze 

sole 

scjuirrel 

some 

stable 

somebody 

stack 

somehow 

stage 

someone 

stair 

something 

stall 

sometime (s) 

stamp 

somewhere 

stand 

son 

star 

song 

stare 

soon 

start 

sore 

starve 

sorrow 

state 

sorry 

station 

sort 

stay 

soul 

steak 

sound 

steal 

soup 

steeun 

sour 

steamboat 

south  (ern) 

steamer 

space 

steel 

spade 

steep 

spank 

steeple 

sparrow 

steer 

speak(er) 

stem 

spear 

step 

speech 

stepping 

speed 

stick (y) 

spell (ing) 

stiff 

spend 

still (ness) 

spent 

sting 

spider 

stir 

spike 

stitch 

spill 

stock 

spin 

stocking 

spinach 

stole 

spirit 

stone 

spit 

stood 

splash 

stool 

spoil 

stoop 

spoke 

stop 

spook 

stopped 

spoon 

stopping 

sport 

store 

spot 

stork 

spread 

stories 

spring 

storm (y) 

story 

sweetheart 

stove 

swell 

straight 

swept 

strange (r) 

swift 

strap 

swim 

straw 

swimming 

strawberry 

swing 

stream 

switch 

street 

sword 

stretch 

swore 

string 

table 

strip 

tablecloth 

stripes 

tablespoon 

strong 

tablet 

stuck 

tack 

study 

tag 

stuff 

tail 

stump 

tailor 

stung 

take (n) 

subject 

taking 

such 

tale 

suck 

talk(er) 

sudden 

tall 

suffer 

tame 

sugar 

tan 

suit 

tank 

sum 

tap 

summer 

tape 

sun 

tar 

Sunday 

tardy 

sunflower 

task 

sung 

taste 

sunk 

taught 

sunlight 

tax 

sunny 

tea 

sunrise 

teach (er) 

sunset 

team 

sunshine 

tear 

supper 

tease 

suppose 

teaspoon 

sure (ly) 

teeth 

surface 

telephone 

surprise 

tell 

swallow 

temper 

swam 

ten 

swamp 

tennis 

swan 

tent 

swat 

term 

swear 

terrible 

sweat 

test 

sweater 

than 

sweep 

thank (s) 

sweet (ness) 

thankful 

Thanks-giving 

tiny 

trip 

upward 

that 

tip 

trolley 

us 

that  * s 

tiptoe 

trouble 

use (d) 

the 

tire 

truck 

useful 

theater 

tired 

true 

valentine 

thee 

' tis 

truly 

valley 

their 

title 

trunk 

va luable 

them 

to 

trust 

value 

then 

toad 

truth 

vase 

there 

toadstool 

try 

vegetable 

these 

toast 

tub 

ve Ivet 

they 

tobacco 

Tuesday 

very 

they'd 
they ' 11 

today 

tug 

vessel 

toe 

tulip 

victory 

they ' re 
they ' ve 

together 

tumble 

view 

toilet 

tune 

village 

thick 

told 

tunnel 

vine 

thief 

tomato 

turkey 

violet 

thimble 

ton 

turn 

visit 

thin 

tone 

turtle 

visitor 

thing 

tongue 

twelve 

voice 

think 

tonight 

twenty 

vote 

third 

too 

twice 

wag 

thirsty 

took 

twig 

wagon 

thirteen 

tool 

twin 

waist 

thirty 

toot 

two 

wait 

this 

tooth 

ugly 

wake (n) 

tho 

toothbrush 

umbrella 

walk 

thorn 

toothpick 

•uncle 

wall 

those 

top 

under 

walnut 

though 

tore 

understand 

want 

thought 

torn 

underwear 

war 

thousand 

toss 

undress 

warm 

thread 

touch 

unfair 

warn 

three 

tow 

unfinished 

was 

threw 

toward (s) 

unfold 

wash  (er) 

throat 

towel 

unfriendly 

wash tub 

throne 

tower 

unhappy 

wasn't 

through 

town 

unhurt 

waste 

throw (n) 

toy 

uniform 

watch 

thumb 

trace 

United  States 

watchman 

thunder 

track 

unkind 

water 

Thursday 

trade 

unknown 

watermelon 

thy 

train 

unless 

waterproof 

tick 

tramp 

unpleasant 

wave 

ticket 

trap 

until 

wax 

tickle 

tray 

unwilling 

way 

tie 

treasure 

up 

wayside 

tiger 

treat 

upon 

we 

tight 

tree 

upper 

weak (ness) 

till 

trick 

upset 

weaken 

time 

tricycle 

upside 

wealth 

tin 

tried 

upstairs 

weapon 

tinkle 

trim 

uptown 

wear 

weary 

whirl 

weather 

whisky 

weave 

whisper 

web 

whistle 

we  * d 

white 

wedding 

who 

Wednesday 

who  'd 

wee 

whole 

weed 

who ' 11 

week 

whom 

we ' 11 

who's 

weep 

whose 

weigh 

why 

welcome 

wicked 

well 

wide 

went 

wife 

were 

wiggle 

we're 

wild 

west (ern) 

wildcat 

wet 

will 

we  * ve 

willing 

whale 

willow 

what 

win 

what ' s 

wind (y) 

wheat 

windmill 

wheel 

window 

when 

wine 

whenever 

wing 

where 

wink 

which 

winner 

while 

winter 

whip 

wipe 

whipped 

wire 

wise 

wove 

wish 

wrap 

wit 

wrapped 

witch 

wreck 

with 

wrein 

without 

wring 

woke 

write 

wolf 

writing 

woman 

written 

wcxnen 

wrong 

won 

wrote 

wonder 

wrung 

wonderful 

yard 

won't 

yarn 

wood ( en ) 

year 

woodpecker 

yell 

woods 

ye 1 low 

wool 

yes 

woolen 

yesterday 

word 

yet 

wore 

yolk 

work(er) 

yonder 

workman 

you 

world 

you ' d 

worm 

you • 11 

worn 

young 

worry 

youngster 

worse 

your  (s) 

worst 

you ' re 

worth 

yourself 

would 

yourselves 

wouldn ' t 

youth 

wound 

you ' ve 

'I  • • 
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APPENDIX  F 
ACTIVITY  VERB  LIST  ^ 

The  concept  of  "activity  verbs",  as  the  term  is  used  in 
this  report,  emphasizes  standardized  definitions  and  hierarchies 
of  difficulty  and  complexity  in  required  perforiaance.  In  a 
sense,  the  terminology  is  redundant,  since  a "verb"  is  by 
definition  a word  expressing  an  action.  "Activity  verbs", 
however,  are  selected  words,  listed  — with  their  precise 
meanings  — for  the  convenience  of  job  analysts.  Because 
definitions  are  sharply  limited,  they  facilitate  the  reporting 
and  recording  of  what  may  be  significant  distinctions  among 
actions  '-■r  activities.  For  the  same  reason,  they  permit 
meaningful  comparisons  of  action  in  a variety  of  jobs. 

In  use,  an  activity  verb  list  serves  as  a guide  for  job 
analysts  in  organizing  and  writing  definitive  statements  with 
respect  to  each  major  activity  in  a job.  With  the  activity 
verb  list  at  hand,  the  analyst  has  before  him  a standardized, 
classified,  and  indexed  vocabulary.  An  activity  he  describes 
as  "compiling",  for  example,  can  be  assumed  to  be  quite  similar 
to  what  another  analyst,  looking  at  another  job,  would  see  and 
describe  with  the  same  activity  verb. 

The  need  for  and  potential  usefulness  of  such  verbs  be- 
came evident  in  the  investigation  of  several  new  approaches 
to  job  analysis.  It  is  clear  that,  since  a job  is  precisely 
defined  as  work  or  effort  to  get  something  accomplished,  any 
description  of  the  job  must  emphasize  what  is  done.  The 

1.  This  discussion  of  activity  verbs  is  based  upon  the  description  of 
the  "Activity  Verb  List"  in  Stone,  C.  Harold  and  Yoder,  Dale,  JOB 
ANALYSIS  1970,  (Appendix  C) , California  State  University,  Long  Beach, 
1970. 
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"doing"  involves  action;  its  description  requires  a verb. 

done  in 

Thus  activity  verbs  describe  what  is^^ assigned  positions  in 
hierarchies  of  required  capabilities  according  to  a revision 
of  the  UST&ES  "worker  function"  classification. 

Identification  of  appropriate  levels  and  positions  in  the 
"data"  and  "people"  areas  can  be  accomplished  on  the  basis  of 
the  action  itself.  This  seems  not  to  be  the  case  in  the 
"things"  area,  where  ordering  or  ranking  depends  largely  on  the 
object  of  the  action.  Thus,  for  example,  a "things"  activity 
verb  such  as  "cut"  can  be  realistically  defined  and  placed  in 
the  hierarchy  of  functions  only  if  the  object  being  cut  is 
carefully  noted  and  considered.  Cutting  lumber  does  not  rate 
the  same  position  as  cutting  dictmonds.  It  appears  at  this 
time  that  task  statements  in  the  "things"  area  can  be  ranked 
in  terms  of  their  verbs  only  when  the  verbs  are  considered 
in  context.  The  entire  task  statement  must  be  recorded  and 
evaluated . 

Both  as  a contribution  to  the  meaning  of  activity  verbs 

and  as  a convenience  in  indicating  relationships  among  jobs, 

the  ranking  process  and  the  creation  of  hierarchies  can  be 

helpful.  In  the  areas  of  people  and  data,  the  principal 

criteria  for  ordering  appear  to  be  the  complexity  of  the  action 

and  the  level  of  reejuired  skills.  In  the  "things"  area,  these 

criteria  may  be  applicable,  but  their  application  is  in  itself 

2 

more  difficult. 


# 


2 . In  one  experimental  approach  to  this  problem  as  it  arose  in 
analyzing  machine  shop  jobs,  task  statements  were  evaluated 
on  a dual  scale,  one  involving  degrees  of  manual  dexterity 
and  the  other  degrees  of  complexity.  The  total  task  was 
positioned  in  the  hierarchy  on  the  basis  of  the  highest  degree 
on  the  two  scales. 


♦ 
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MODIFIED  WORKER  FUNCTIONS 

In  the  process  of  developing  the  list  of  activity  verbs 

3 

and  assigning  them  to  the  various  levels  of  the  D.O.T.  "worker 
function"  hierarchy,  several  modifications  in  that  hierarchy 
seemed  necessary.  In  the  "data"  area,  the  function  described 
as  "computing"  was  retitled  to  become  "figuring".  "Comparing" 
was  retitled  "discriminating".  These  changes  seemed  to  conform 
more  closely  to  common  usage. 

Also,  in  the  "data"  area,  the  ordering  was  modified  to 
assign  a somewhat  lower  rank  to  "compiling"  than  was  accorded 
this  verb  in  the  original  hierarchy.  "Compiling"  was  redefined, 
after  a careful  review  of  current  definitions.  The  D.O.T. 
defines  the  term  as; 

COMPILING;  Gathering,  collating,  or  classifying  infor- 
mation about  data,  people,  or  things.  Reporting  and/or 
carrying  out  a prescribed  action  in  relation  to  the 
information  is  frequently  involved. 

The  revised  definition  is  as  follows; 

COMPILING;  Measuring  and  collecting  information  about 
data,  people,  or  things. 

In  the  functional  area  of  "people",  a general  category  of 
"educating"  was  substituted  for  "instructing"  to  permit  a more 
specific  definition  of  "instruct".  Similarly,  the  general 
category  of  "superintending"  has  been  tentatively  substituted 
for  "supervising"  to  permit  use  of  "supervise"  as  a specific 
verb  within  the  broader  category.  The  D.O.T.  list  has  been 


i.  U.S.  Department  of  labor,  DICTIONARY  OF  OCCUPATIONAL  TirUES-OOCUPATIONAL 
CLASSIFICATICW,  3rd  ed.  , Washingtcm:  U.S.  Government  Printing  Office, 
Vol.  II,  1965. 
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further  modified  by  deleting  "taking  instructions — helping", 
because  such  action  does  not  result  directly  in  a product  or 
service.  Verbs  that  would  have  been  classified  under  "helping"  0 

are  presently  included  under  "serving". 

In  the  "people"  area,  "diverting"  also  has  been  redefined. 

The  older  definition  indicates  the  meaning  as  "amusing  others".  • 

The  tentative  revision  is  more  specific;  it  defines  "diverting" 

as: 


DIVERTING : Drawing  the  mind  away  from  serious  thoughts  or 
pursuits;  distracting  the  attention  from  work,  worry. 


pain,  or  commonplace  concerns  and  focusing  it  on  pleasure. 


The  modified  hierarchies  for  "data"  and  "people"  thus 
become; 


DATA 

PEOPLE 

10 

SYNTHESIZING 

20 

MENTORING 

11 

COORDINATING 

21 

NEGOTIATING 

12 

ANALYZING 

22 

EDUCATING 

13 

DISCRIMINATING 

23 

SUPERINTENDING 

14 

FIGURING 

24 

DIVERTING 

15 

COMPILING 

25 

PERSUADING 

16 

COPYING 

26 

SPEAKING/SIGNALING 

27 

SERVING 

For 

convenient  comparison. 

the  D.O.T.  " 

data"  and  "people" 

lists  are  as  follows: 


DATA 

0 SYNTHESIZING 

1 COORDINATING 

2 ANALYZING 

3 COMPILING 

4 COMPUTING 

5 COPYING 

6 COMPARING 

7)  NO  SIGNIFICANT 

8) 


0 

1 

2 

3 

4 

5 

6 

RELATIONSHIP  7 

8 


PEOPLE 

MENTORING 

NEGOTIATING 

INSTRUCTING 

SUPERVISING 

DIVERTING 

PERSUADING 

SPEAKING-SIGNALING 

SERVING 

NO  SIGNIFICANT 
RELATIONSHIP 
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USE  OF  THE  LIST 

Later  pages  in  this  Aopendix  list  activity  verbs  for  "data" 
and  "people"  and  the  definitions  attached  to  each  verb. 

Sources  of  each  definition  are  indicated  by  code  in  which  "W"  means 
Webster's  Dictionary  (Third  World  and  Collegiate  editions);  "FiW" 
means  Hayakawa,  S.  I.  and  the  Funk  & Wagnalls  Dictionary  Staff, 

Modern  Guide  to  Synonyms  and  Related  Words,  flew  York:  Funk  & Wagnalls, 
1968;  and  "S"  identifies  definitions  developed,  after  consulting 
these  and  other  sources,  by  members  of  the  research  staff. 

It  is  important,  for  a full  understanding  of  the  application 
and  use  of  these  lists,  to  note  that  the  only  indicator  of  rank  is  that 
of  each  major  worker  function.  Within  each  function,  verbs lare  grouped 
according  to  similarity  of  meaning.  The  sub-groupings  have  been 
developed  for  convenience  to  permit  greater  precision  in  finding  the 
closest  approximation  to  the  activity.  In  the  list  as  presented  here, 
verbs  beginning  with  capital  letters  are  regarded  as  "general", 
serving  to  classify  the  more  specific  but  related  verbs  that  begin  with 
lower-case  letters. 

Major  worker  functions  are  coded  by  number.  That  same  code 
applies  to  each  verb  in  each  functional  level.  The  first  digit  of 
the  code  indicates  the  area;  "1"  means  "data",  "2"  means  "people"; 
and  "3"  would  refer  to  "things".  The  second  digit  identifies  the 
worker  function  level,  with  the  highest  designated  "0",  and  other 
lower-scaled  functions  indicated  as  "1",  "2",  etc. 

Use  of  the  list  may  best  be  described  by  illustration.  Suppose, 
an  analyst  seeking  to  develop  a job  description  for  an  accounting 


# 
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job  interviev/s  an  incumbent.  He  takes  notes  on  what  he  observes 
and  what  the  employee  sgys.  One  statement  by  the  incumbent  states 
that  he  "looks  at  accounting  records  to  form  an  opinion  as  to  their 
dependability."  The  analyst,  reviev/ing  his  notes  as  he  writes  up 
what  he  has  learned  about  the  job,  needs  a more  definitive  verb 
than  "looks  at". 

He  can  find  the  list  helpful  at  this  point,  and  use  of  the  list 
can  make  the  resulting  job  description  both  more  precise  and  more 
readily  comparable  with  those  of  other  jobs.  The  area  is  clearly 
"data".  Within  that  area,  the  most  appropriate  verb  will  probably 
be  found  in  the  "analyzing"  or  "discriminating"  levels.  Within 
these  levels,  several  verbs  appear  worthy  of  consideration,  including 
"scrutinizing",  "examine",  "audit",  "verify",  and  "inspect".  The 
analyst  studies  the  attached  definitions  and  selects  "audit"  as  the 
most  appropriate;  it  is  defined  as  "to  examine  accounts  or  records". 

He  then  writes  the  element  statement  as  "audits  accounting  records". 

In  the  JIMS  experimental  procedure,  element  task  statements 
from  a variety  of  sources  were  revised,  using  this  procedure.  The 
rewritten  statements  were  more  meaningful  and  the  activity  was  auto- 
matically assigned  to  the  appropriate  worker  function  and  level..  In 
the  following  examples,  worker  functions  are  indicated  in  parentheses. 

"Plans  methods  for  machining  non-standard  v/orkpieces" 

(10-SYNTHESIZING) 

"Formulates  machining  instructions  for  others"  (11 -Coordinating) 

"f-leasures  parts  to  determine  conformance  to  specifications" 

(15-COI'iPILING) 

"Demonstrates  safety  practice  to  workers"  (22-TEACHING) 

"Assigns  duties  to  subordinates"  (23-SUPERINTENDING) 
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Pages  that  follow  first  list  activity  verbs  for  data  and  people 
by  function;  thereafter  each  of  these  verbs  is  defined.  The  last  two 
pages  index  all  the  activity  verbs,  with  page  references. 


CLASSIFICATION  OF  ''DATA"  ACTIVITY  VERBS 


10.  SYNTHESIZING 


Devise 

compose 

invent 

discover 

hypothesize 

plan 

design 

Solve 

calculate 

forecast 

interpret 

translate 

11.  COORDINATING 


Direct 

manage 

implement 

control 

regulate 

authorize 

execute 

Decide 

deliberate 

determine 

Develop 

formulate 

Organize 

marshal 

schedule 


Evaluate 
veri fy 
appraise 
test 
Report 
identi  fy 
recommend 
summarize 
suggest 

13.  DISCRIMINATING 


Compare 
rank 
inspect 
distinguish 
contrast 
select 
choose 
Cl assi fy 
grade 
index 
segregate 
sort 
match 
arrange 

14.  FIGURING 

Estimate 

Compute 

Plot 


count 
observe 
smell 
1 is ten 

16.  COPYING 


Record 

post 

tabulate 

list 

transpose 

Duplicate 

transcribe 

quote 


12.  ANALYZING  15.  COMPILING 


Investigate 

research 

experiment 

study 

Scrutinize 
examine 
audi  t 
scan 


Measure 

time 

weigh 

calibrate 

Collect 

accumulate 

inventory 
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CLASSIFICATION  OF  "PEOPLE"  ACTIVITY  VERBS 


20.  MENTORING 


24. 


Treat 

prognosticate 

diagnose 

prescribe 

Advise 

counsel 

console  25. 

reconcile 
Arbitrate 
judge 

21.  NEGOTIATING 


Medi ate 
settle 
debate 
bargain 
reason 
confer 

22.  EDUCATING 


26. 


Teach 

lecture 

tutor 

explain 

instruct 

Coach 

demonstrate 

train 

23.  SUPERINTENDING  27. 


Supervise 

lead 

order 

appoint 

assign 

enforce 

rate 


DIVE^NG 

Entertai n 
humor 
interest 
amuse 
imitate 

PERSUADING 

Influence 

motivate 

convince 

Promote 

Solicit 

Sell 

SPEAKING/SIGNALING 

Discuss 

interview 

consult 

question 

Inform 

dictate 

answer 

describe 

indicate 

relay 

request 

Meet 

greet 

SERVING 

Assist 
usher 
Attend 
wait  upon 
Supply 
provi de 
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“DATA"  ACTIVITY  VERB  DEFINITIONS 


• 10  - SYNTHESIZING 


Devise 


compose 


Integrating  analyses  of  data  to  discover 
facts  and/or  develoo  knowledge  concents 
or  interoretations.  (D.O.T.) 

to  form  in  the  mind  by  new  combinations  or 
aopli cations  of  ideas  or  orincioles  (W) 

To  create  by  artistic  labor  (W)  [e.g.,  a 
musical  score  or  painting] 


invent 


discover 


hypothesize  - 


plan 
design 
Sol  ve 


calculate 


forecast 


interpret 


translate 


to  fabricate  something  useful;  usually  as 
a result  of  ingenious  thinking  or  exoeri- 
mentation  (W) 

implies  an  intentional  search;  always 
suggests  the  acquiring  of  something 
that  already  exists  but  is  new  to  ^e 
discoverer.  (F&W) 

[to  form]  a tentative  assumption. . .in 
order  to  draw  out  and  test  its  logical 
or  empirical  consequences.  (W) 

to  work  out  roughly  in  the  mind  a detailed 
means  of  achieving  an  objective  or  goal  (S) 

to  devise  the  form  or  shaoe  of  a physical 
object  (S) 

to  answer  a question  or  work  out  a 
problem...;  exolaining  any  set  of  events 
by  finding  a workable  way  of  dealing  with 
them  or  by  seeing  the  deeoer  meaning  of 
them  (F&W) 

to  ascertain  or  determine  by  mathematical 
processes. . .Calculate  is  usually  preferred 
in  reference  to  highly  intricate  orocess 
and  problematical  rather  than  exact  or 
definite  result.  (W)  Not  to  be  confused 
with  compute  under  "FIGURING." 

to  calculate  or  predict  (some  future  event 
or  condition)  usually  as  a result  of 
rational  study  and  analysis  of  available 
pertinent  data  (W)  Not  to  be  confused  with 
the  less  complex  estimate  under  "FIGURING." 

using  "knowledge  or  insight  to  cast  light 

on  some  baffling  oroblem  or  nuzzle 

stressing  personal  judgment  or  under-  ; 
standing"  (F&W) 

to  transfer  or  turn  from  one  set  of  symbols 
into  another  (W) 
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COORDINATING 


Di rect 


manage 

implement 

jr 

control 

regulate 

authorize 

execute 

Decide 

del i be rate 

determi ne 

Develop 

formul ate 

Orqani ze 

marshal 

schedule 


Determining  time,  olace,  and  sequence  of 
operations  or  actions  to  be  taken  on  the 
basis  of  analysjs  of  data;  executing  deter- 
minations and/or  reoortinq  on  events  (D.O.T.) 

to  exercise  leadershio  and  control  at  the 
highest  level;  authority  is  often  deleoated 
to  others  (e.g.,  coroorate  director)  (S) 

Syn:  Administer 

...often  refers  to  the  actual  running  or 
handling  of  soecific  affairs,  and  may  imnly 
delegated  authority  (F&W) 

to  give  oractical  effect  to  and  ensure 
actual  fulfillment  by  concrete  measures  (V') 

is  the  function  of  maintaining  awareness  and 
appraisal  with  respeqjt  to  the  effectiveness 
o|f  the  organization  at/d  its  parts  in  accom- 
ulishinq  assigned  missions  (Yoder,  Personnel 
Management  h Industrial  Relations,  1962, P. 61^) 

...Means  to  order  or  control  by  rule,  method, 
or  established  mode  (F&W) 

...[to  give]  aooroval  of  a oroposed  course  of 
action  by  an  authority  empowered  either  to 
oermit  or  to  forbid  it.  (F&W) 

to  follow,  carry  out,  or  out  into  effect 
[the  direction  of  others]  (F&w) 

to  arrive  at  a decision  that  ends  uncertainty 

(S)  . 

to  reach  a decision  only  after  intense  analysis; 
the  variables  involved  are  highly  abstract; 
the  consequences  o^  the  decision  are  considerabl 
(S) 

to  reach  a decision  only  after  intense  analysis; 
the  variables  involved  are  readily  apparent, 
but  the  consequertces  of  the  decision  are  con- 
siderable (S) 

...Dositive  change  in  which  an  existing  or 
rudimentary  [idea]  is  improved,  evoked,  or 
perfected  (F&W) 

...refers  to  an  act... in  which,  the  rough 
plan  is  spelled  out,  formalized,  or  out 
i n to  words  (F&W) 

to  set  up  an  administrative  structure  in 
order  to  form  a coherent  or  functioning 
whole  (S) 

...items  are  brought  together  and  ordered 
for  greatest  efficiency  or  for  the  most 
forceful  effect  possible  (F&W) 

to  apooint,  assign,  or  designate  for  a 
fixed  future  time  (W) 
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I . 


ANf\LYZ:’.G 


Investi gate 

research 

experiment 

study 

Scruti  ni  ze 

examine 

audi  t 
scan 

Eval uate 

veri fy 

appraise 

test 

Report 


identi fy 


recommend 


summari ze 


Examining  and  evaiuatina  data,  p'-osentinq 
alternative  actions  in  relation  to  the 
evaluation  is  freouently  involved.  (D.O.T.) 

to  investigate  is  to  ma'^e  a mathodical  , 
searching  inquiry  into  a corn  lax  situation 
in  an  effort  to  uncover  the  facts.  (FiW) 


to  investigate  in  order  to  discover  or 
interpret  facts,  or  to  revise  accented 
laws  or  theories  (S) 

to  test  a theorv  or  hypothesis  under 
controlled  conditions  (S) 

to  attempt  to  learn  all  asnects  o^  the 
subject  or  problem  under  scrutiny  before 
making  plans  or  taking  definite  action  (Fi'J) 

to  look  something  complex  over  closely  but 
not  necessarily  in  a systematic  method  as 
in '"INVESTIGATE."  (S) 

[to  scrutinize]  in  order  to  determine  the... 
condition  or  nature  of  a thing  (W) 

to  examine  accounts  or  records  (F&Vl) 

[to  survey]  from  ncint  to  noint  often 
suggesting  a cursory  overall  observation,  (w) 

to  determine  or  fix  the  value  of  through 
analysis  of  complex  data.  (S) 

to  confirm  or  establish  the  authenticity  or 
existence  of  by  examination,  inyestigation, 
or  competent  evidence.  (W) 

to  .iudge  tentatively  or  approximately  t.he 
value,  worth,  or  significance  of  (W  defin- 
ition for  "estimate") 

to  iudge  the  oerformance  of  something 
relative  to  readily  observable  standards  (S) 

implies  giving  an  account  of  something 
wi th ...  formal  attention  to  details  and 
to  accuracy  in  the  presentation  of  the 
relevant  facts  and  information  (F&W) 

to  point  out  the  salient  characteristics 
of  something  or  associate  it  with  some 
other  thing.  The  characteristics  and  • 
association  are  not  readily  apparent  (S) 

...indicates  a positive  declaration, 
based  on  analysis  of  complex  data,  in 
favor  of  a particular  alternative  or 
set  of  possibilities  (F&W) 

to  tell  in,  or  reduce  to,  a summary  (W) 


12  - ANALYZING  (Continusd) 
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suggest 

13  - DISCRIMINATING 

Compare 

rank 

inspect 

distinguish  - 

contrast 

select 

choose 

Clt'^ssi  fy 

grade 

i ndex 


to  call  or  bring  to  mind  (as  an  idea, 
mood,  or  object)  by  a process  of  logical 
thought  or  natural  association  of  ideas  (W) 


Comparing  and  classifying  information 
about  data,  oeoole,  or  things.  Reporting 
and/or  carrying  out  a orescribed  action 
in  relation  to  the  discrimination  is 
frequently  involved.  (S) 

to  examine  the  readily  apparent  character 
or  qualities  o-f,  especially  to  discover 
resemblances  or  di fferences .. .implies  an 
aim  of  showing  relative  values  or  excel- 
lence by  bringing  out  characteristic 
qualities  whether  similar  or  divergent  (W) 

to  determine  or  assign  the  relative  rank 
or  class  of  (W)  Requires  more  discretion 
than  grade. 

[to  compare  critically]  to  a standard  of 
excellence,  quality,  or  the  like,  with  a 
view  toward  noting  discreoancies  or  defi- 
ciencies . . . (F&W) 

...it  suggests  the  making  of  even  finer 
distinctions  than  compare  or  contrast 
and  making  them  among  things  even  more 
closely  resembling  each  other.  (S) 

to  compare  with  an  aim  of  nointina  out 
differences  but  not  determining  relative 
values  (S) 

to  decide  on  one,  or  a few,  from  several 
possibilities;  variables  are  readily 
apparent  and  the  consequences  are  not  as 
great  as  in  determine  and  deliberate 
under  " COORD IHaTL."  (S)  ' . 

to  decide  on  one  of  two  alternatives; 
the  variables  and  consequences  are  the 
same  as  in  select,  (s) 

to  group  or  segregate  in  classes  that 
have  systematic  relations  usually  founded 
on  conmon  properties  or  characters.  (W) 

to  divide  into  grouns  based  on  ascending 
or  descending  order;  relative  rank  or 
class  is  prescribed  (S) 

to  classify  information,  usually  on  the 
'basis  of  subject  matter  or  name,  to 
facilitate  reference  (S) 


% 


13  - DISCRIMINATING  (Continued) 
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segregate 


sort 


match 

arrange 


to  separate  or  set  apart  from  others  or 
from  the  general  mass  f'-O 

...suggests  the  selection  of  items 
according  to  tyoe;  this  orocess  is 
closely  related  to  the  categorizing 
process  indicated  by  " c 1 as s i fy . (FAW) 

to  pair  un  or  out  in  a set  as  possessing 
equal  or  harmonizing  attributes  fw) 

...most  often  indicates  the  shifting 
about  of  items  according  to  plan,  but 
without  necessarily  altering  the  items 
themselves  (FAW) 


14  - FIGURING 


Estimate 


Compute 


Plot 


Performing  arithmetic  operations  on 
and/or  carrying  out  a prescribed  action 
in  relation  to  them.  Does  not  include 
counting.  (D.O.T.) 

to  determine  roughly  the  size,  extent, 
or  nature  of  Not  the  same  as  forecast 
in  "SYNTHESIZING" 

to  arrive  at  an  answer  by  simple  (arithmetic) 
means. (W)  Compute  is  not  to  be  confused  with 
calculate  (under  "SYNTHESIZE")  which  applies 
to  highly  abstruse  and  problematical  questions. 

to  determine  the  physical  position  of  by 
mathematical  means  (S) 


15  - COMPILING 


Measure 


time 

weigh 

calibrate 

Collect 


accumul ate 


Measuring  and  collecting  information  about 
data,  people,  or  things  (S) 

to  ascertain  the  quantity,  mass,  extent, 
or  degree  of  in  terms  of  a standard  unit 
or  fixed  amount,  usually  by  means  of  an 
instrument  or  container  marked  off  in  the 
units  (W) 

to  determine. . .the  time,  duration,  or 
rate  of  (W) 

to  ascertain  the  heaviness  of  usually  - 
by  use  of  a balancing  device.  (S) 

to  determine  the  graduations  of  (W) 

to  bring  data  together  into  a group... 
implies  careful  selection  (S) 

to  bring  together  by  degrees  or  regular 
additions  (W) 


15  - COMPILING  (Continued) 
inventory 
count 

observe 

smell 

listen 


16  - COPYING 


Record 

post 

tabulate 

list 

transpose 

Duplicate 

transcribe 

quote 
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to  make  an  itemized  reoort  or  record  of; 
take  stock  of  (W) 

to  indicate  or  name  by  units  or  groups 

to  find  the  total  number  O'f  units  • 

involved  (W) 

to  obtain  data  through  visual  insnection  (s) 

to  examine  the  odor  or  scent  of  with 
the  nose  (S) 

to  pay  attention  to  sound;  nerceive 
with  the  ear.... to  be  alert  to  catch 
an  expected  sound  (W) 


Transcribing,  entering,  or  posting 
data  (D.O.T.) 

to  make  a written  note  or  account  o-^  ('*0 

to  transfer  (an  entry  or  item)  from  one 
record  to  another  (W) 

to  put  into  tabular  form  (W) 

to  enumerate  one  after  another  (S) 


to  change  the  relative  place  or  normal 

order  of  (W)  ^ 

to  make  a duplicate,  copy,  or  transcriot 
of  (W) 

to  make  a cooy  of  (dictated  or  recorded 
matter)  in  longhand  or  on  a tyoewriter  (W) 

to  write  (a  passage)  from  another  usually  • 

with  credit  acknowledgment  (W) 


"PEOPLE"  ACTIVITY  VERB  DEFINITIONS 


MENTORING 

Treat 

prognosticate  - 

diagnose 

prescribe 

Advise 

counsel 

console 
reconcile 
Arbi trate 

judge  , - 

f 

/ 

/ 

NEGOTIATING 

Mediate 


Dealing  with  individuals  in  terms  of 
their  total  oersonality  in  order  to 
advise,  counsel,  and/or  guide  them 
with  regard  to  oroblems  that  may  be 
resolved  by  legal,  scientific,  clinical, 
spiritual,  and/or  other  professional 
principles.  (D.O.T.) 

To  treat  medically  is  to  accent  someone 
as  a oatient,  to  diagnose  his  illness, 
and  to  relieve  it.  (F&W) 

...to  take  a knowledgeable  look  at  the 
symptoms  of  a disease  in  order  to 
determine  its  likely  outcome.  (FiW) 

to  identify  (as  a disease  or  condition) 
by  symptoms  or  distinguishing  character- 
istics (W) 

to  recommend  (medical  treatment)  with 
authority  (W)  (F&W) 

...to  give  a oerson  facts  that  involve 
his  own  interests  (F&W) 

to  advise  seriouslv  and  formally  after 
consultation  so  as  to  avoid  rash  actions 
(W) 

...to  mitigate  the  serious  grief  felt  bv 
another  (F&W) 

to  restore  to  friendshin,  comoatibil ity , 
or  harmony  (W) 

...to  act  with  absolute  oower  to  decide 
a dispute  (W) 

to  hear  and  determine  or  decide  in  the 
case  of  (as  a nerson)  in  or  as  if  in  a 
court  0^  justice  (W);  to  make  decisions 
or  pass  upon  the  merits  of  something  (F&w) 


Exchanging  ideas,  information,  and 
opinions  with  others  to  formulate 
Dolicies  and  orograms  and/or  arrive 
jointly  at  decisions,  conclusions 
or  solutions . (D.O.T. ) 

...to  attempt  to  bring  extremes  together 
or  to  function  as  a form  of  communication 
between  them.  (F&W) 


21  - NEGOTIATING  (Continued) 


22 


settle 

debate 

bargain 

reason 

confer 


...to  reach  a definite  or  final  choice 
after  a oeriod  of  indecision  or  disoute 
( F&W) 

to  argue  formally,  usually  under  the 
control  of  a referee  and  according  to 
a set  of  regulations  (F&W) 

...to  negotiate  over  the  terms  of  a 
Durchase,  agreement,  or  contract.  (W) 

to  argue  or  discuss  in  a careful  and 
painstaking  manner  in  order  to  oersuade 
or  explore  a subiect  in  deoth  (F&W) 

to  hold  conversation  or  conference.  Now 
typically  on  important,  difficult,  or 
complex  matters.  (W) 


EDUCATING 


Teach 

lecture 

tutor 

explain 

instruct 

Coach 

demonstrate 


Developing  the  growth  or  expansion  of 
knowledge,  wisdom,  desirable  qualities 
of  mind  or  character,  physical  health, 
or  general  competence  especially  by  a 
course  of  formal  study  or  instruction. (W) 

...to  apply  a guided  process  o^  assigned 
work,  discipline,  directed  study,  and 
the  presentation  of  examples . (F&W) 

to  deliver  a discourse  given  before  an 
audience  especially  -For  instruction  (W) 

to  teach,  guide,  or  instruct  on  an  . , 
individual  basis  and  in  a special  sub — 
.ject  or  for  a particular  occasion  or 
purpose.  (W) 

to  clarify  or  make  acceptable  to  under- 
standing something  that  is  mysterious, 
causeless,  or  inconsistent.  (W) 

to  guide  training  or  to  impart  informa- 
tion or  commands  (F&W) 

to  train  intensively  by  instruction, 
demonstration,  and  repeated  practice. 

(W) 

to  make  evident  or  reveal  as  true  by 
reasoning  processes,  concrete  facts  and 
evidence,  experimentation,  operation, 
or  repeated  examples.  (W) 

...to  systematically  develop  the  body 
or  mind  for  the  purpose  of  acQuirinq 
proficiency  in  some  physical  or  mental 
pursuit.  (F&W) 


train 
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23  - SUPERINTENDING 


Determining  or  interoretinq  work 
procedures  ^'or  a group  of  workers, 
assigning  specific  duties  to  them, 
maintaining  harmonious  relations 
among  them,  and  promoting  efficiency. 
(D.O.T.) 


Supervise 

lead 

order 

appoint 

assign 

enforce 


rate 


to  stress  guidance  and  the  exercise 
of  leadership  of  a grouo  of  workers 

to  take  a principal  or  directing  part 
in;  have  charge  or  direction  of  (W) 

to  issue  commands  (W) 

to  designate  (a  person)  in  whom  shall 
be  vested  the  responsibility  of  per- 
forming a given  task  (S)  Syn:  designate 

to  delegate  a task  to  one  or  more  members 
of  a group  (F&W) 

[To  Require]  operation,  observance,  or 
protection  of  laws,  orders,  contracts, 
and  agreements  by  authority  (W) 

to  evaluate  the  work  performance  of  a 
subordinate  relative  to  specific  standards 
(W) 


24  - DIVERTING 


Entertain 

humor 

interest 

amuse 

imitate 


to  draw  the  mind  away  from  serious 
thoughts  or  pursuits;  distracting  the 
attention  from  work,  worry,  pain,  or 
commonplace  concerns  and  focusing  it 
on  pleasure  (F&W) 

...to  provide  some  occupation  that  will 
afford  pleasure  or  relieve 
monotony  or  boredom  (F&W) 

to  comply  with  someone's  moods,  fancies, 
or  capricious  demands,  though  they  may 
seem  extreme  (s) 

to  excite  or  hold  one's  curiosity  or 
attention  (F&'-O;  to  engage  or  attract 
the  attention  of  someone  (W) 

...to  provide  any  form  of  distraction 
that  contents  the  mind  (F&W) 

...to  repeat  convincingly  or  tellingly 
the  recognizable  features  of  the  model; 
suggests  following  a model  or  pattern 
without  precluding  some  variation  (W) 
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25  - PERSUADING 

Influence 

motivate 

convince 

Promote 

Solicit 

Sell 


Influencing  others  in  favor  of  a 
product,  service,  or  point  of  view. 
(D.O.T.) 

...to  bring  about  a change  in  another's 
actions  or  thoughts  by  oersuasion  (F&W) 

to  consciously  attempt  to  stimulate  the 
active  interest  or  desire  for  something 
(S) 

to  bring  by  argument  to  assent  or  belief. 
(W);  compels  one's  belief  in  its  sound- 
ness because  it  satisfies  the  sense  of 
logic  or  fitness  (F&W) 

...to  influence  in  an  aggressive  and 
deliberate  manner,  usually  with  a 
specific  aim  in  mind  (S) 

to  move  to  action;  serve  as  an  urge  or 
incentive  to  (W) 

to  give  up  to  another  for  money  or  other 
valuable  consideration  (W) 


26  - SPEAKING/ 
SIGNALING 


Discuss 


interview 


consul t 


question 

Inform 


dicta  te 


talking ’.with  and/or  signaling  oeoole 
to  convey  or  exchange  information; 
includes  giving  assignments  and/or 
directions  to  heloers  or  assistants  (D.O.T.) 

...to  talk  over,  usually  in  an  informal, 
friendly  way;  discuss  points  to  the 
elucidation  of  an  issue  rather  than  to 
the  narrow  presentation  of  one's  own 
view.  (F&W) 

to  question  or  converse  with  esoecially 
in  order  to  obtain  information  or  ascer- 
tain personal  qualities  (W) 

to  clarify  a question  with  emohasis  on 
motive  v/ithout  necessarily  suggesting 
ultimate  agreement  (F&W) 

to  seek  clarification  or  test  knowledge 
of(S) 

...to  call  someone's  attention  to  some- 
thing or  to  cause  him  to  receive  knowledge 
of  it.  (F&W) 

to  speak  or  read  for  a person  to  transcribe 
or  for  a machine  to  record  (W) 


SPtAKiHG/SIGNALING  (Continued) 


answer 

...to  soeak  or  write  in  reoly  to  (W) 

describe 

...to  cite  details  that  will  create  a 
visual  image  in  the  mind  of  an  audience 
(F&W) 

indicate 

...to  stress  a rough  approximation  of 
literal  meaning  of  a sign  or  word  (F&W) 

relay 

to  pass  along  a message,  signal  (VI) 

request 

to  ask  for  a stated  need  with  an  exoect- 
ation  of  response  (S) 

Meet 

to  come  into  the  nresence  of  (W) 

greet 

to  meet  or  receive  with  a salutation  (W) 

SERVING 

attending  to  the  needs  or  requests  of 
the  people  or  animals,  or  the  expressed 
or  imolicit  wishes  of  people.  Inmediate 
response  is  involved.  (D.O.T.) 

Assist 

...to  give  support  or  aid  to  especially 
in  some  undertaking  or  effort;  aid  (W) 

usher 

to  conduct  to  a place  (W) 

Attend 

...to  look  a-Pter  or  take  charge  of  (W) 

wait  upon 

...to  attend  as  a servant;  to  supply  the 
want  of  (W) 

Supply 

to  provide  what  is  needed;  sometimes  to 
make  up  a deficiency,  replacing  losses 
or  depletions,  filling  a gap  (W) 

provide 

to  equip,  stock,  or  give  in  the  interest 
of  preparing  with  foresight  (W) 

ALPHABETIC  INDEX  OF  THE  "ACTIVITY  VFPB  LIST" 


accumulate 

- 

15* 

count 

- 

15 

hvpothesi ze 

- 

in 

Advise 

- 

20 

debate 

- 

21 

identi fv 

- 

12 

amuse 

- 

24 

Decide 

- 

11 

imi tate 

- 

24 

answer 

- 

26 

del i berate 

- 

11 

imnlement 

11 

appoint 

- 

23 

demonstrate 

- 

22 

index 

- 

13 

appraise 

- 

12 

describe 

- 

26 

indicate 

- 

26 

Arbitrate 

- 

20 

design 

- 

in 

influence 

- 

25 

arrange 

- 

13 

determine 

- 

11 

I nform 

- 

26 

assign 

- 

23 

Develop 

- 

11 

i nsoect 

- 

13 

Assist 

- 

27 

Devise 

- 

10 

instruct 

- 

22 

Attend 

- 

27 

diagnose 

- 

20 

interest 

- 

24 

audit 

- 

12 

dictate 

- 

26 

internret 

- 

10 

authori ze 

- 

11 

Di rect 

- 

11 

interview 

- 

26 

bargain 

- 

21 

discover  ' 

- 

10 

invent 

- 

in 

calculate 

- 

10 

Discuss 

- 

26 

inventory 

- 

15 

calibrate 

- 

15 

distinguish 

- 

13 

Investigate 

- 

12 

choose 

- 

13 

Duplicate 

- 

16 

judge 

- 

20 

Classify 

- 

13 

enforce 

- 

23 

lead 

- 

23 

Coach 

- 

22 

Entertain 

- 

24 

lecture 

- 

22 

Collect 

- 

15 

Estimate 

- 

14 

list 

- 

16 

Compare 

- 

13 

Evaluate 

- 

12 

1 is  ten 

- 

15 

compose 

- 

10 

exami ne 

- 

12 

manage 

- 

11 

compute 

- 

14 

execute 

- 

11 

marshal  1 

- 

11 

confer 

- 

21 

experiment 

- 

12 

match 

- 

13 

console 

- 

20 

exnlain 

- 

22 

Measure 

- 

15 

consul t 

- 

26 

forecast 

- 

10 

Mediate 

- 

21 

contrast 

- 

13 

formulate 

- 

11 

Meet 

- 

26 

control 

- 

11 

grade 

- 

13 

moti vate 

- 

?5 

convince 

- 

25 

greet 

- 

26 

observe 

- 

15 

counsel 

20 

humor 

2'' 

order 

23 

* Note:  The  first  digit 
"2"  - "People." 
V'orker  Function 

designates  the  major  -functional  area:  "1"  - "nata;" 
The  second  digit  indicates  the  snecific  level  of 
where  the  Activity  Verb  is  categorized. 
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ALPHABETIC  INDEX  OF  THE  "ACTIVITY  VPPR  LIST"  (Continued) 


Organi ze 

- 11 

suggest 

- 

12 

plan 

- 10 

surma  rize 

- 

12 

Plot 

- 14 

Supervise 

- 

23 

post 

- 16 

Supply 

- 

27 

prescribe 

- 20 

tabulate 

- 

16 

prognosticate 

- 20 

Teach 

- 

2? 

Promote 

- 25 

test 

- 

12 

provi de 

- 27 

time 

- 

15 

question 

- 26 

tra  i n 

- 

2? 

quote 

- 16 

transcribe 

- 

16 

rank 

- 13 

translate 

- 

10 

rate 

- 23 

transpose 

- 

16 

reason 

- 21 

Treat 

- 

20 

recommend 

- 12 

tutor 

- 

22 

reconcile 

- 20 

usher 

- 

27 

Record 

- 16 

veri fy 

- 

12 

regulate 

- 11 

wait  upon 

- 

27 

relay 

- 26 

weigh 

- 

15 

Report 

- 12 

request 

- 26 

research 

- 12 

scan 

- 12 

schedule 

- 11 

Scrutinize 

- 12 

segregate 

- 13 

select 

- 13 

t 

Sell 

- 25 

settle 

- 21 

smel  1 

- 15 

• 

Sol ici t 

- 25 

Solve 

- 10 

sort 

- 13 

study 

- 12 
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